Senior C++ Storage Engineer
Voltron Data
·
Posted:
April 21, 2023
·
Remote
About the position
We are seeking a highly motivated Senior C++ Storage Engineer to join our team at Voltron Data. In this role, you will have the opportunity to support and contribute to the growth of the Voltron Data and Apache Arrow ecosystems. Your main responsibility will be to collaborate closely with our development teams to implement efficient storage and I/O functions for various networked, cloud, and local storage solutions. This position offers the chance to work with cutting-edge technologies and make a significant impact in the field of data analytics.
Responsibilities
- Support and grow the Voltron Data and Apache Arrow ecosystems
- Implement performant storage and I/O functions targeting networked, cloud, and local storage solutions
- Learn about the Apache Arrow memory layout, compute primitives, and APIs
- Familiarize yourself with different partners for compute kernels and the query execution engine on Apache Arrow
- Embrace the Apache development process
- Implement new high-performance storage and I/O primitives
- Benchmark existing I/O library functions to identify bottlenecks
- Optimize data reads and writes
- Participate in peer code review related to file storage and interacting with different filesystems
- Contribute to technical discussions and technical design documents
- Develop a comprehensive set of low-level benchmarks for I/O functions targeting various storage technologies
- Ensure compatibility and performance of filesystem interactions across platforms
- Identify and build reusable software components for a high-quality and maintainable codebase
- Analyze I/O throughput in a massively parallel and distributed query engine to identify inefficiencies and propose solutions
- Build high-quality storage components across the Voltron Data and Apache Arrow ecosystems
Requirements
- Highly motivated Senior C++ Storage Engineer
- Experience in supporting and growing Voltron Data and Apache Arrow ecosystems
- Ability to implement performant storage and I/O functions for networked, cloud, and local storage solutions
- Familiarity with Apache Arrow memory layout, compute primitives, and APIs
- Knowledge of different partners for compute kernels and query execution engine on Apache Arrow
- Understanding and embracing the Apache development process
- Proficiency in implementing new high-performance storage and I/O primitives
- Ability to benchmark existing I/O library functions and identify bottlenecks
- Experience in optimizing data reads and writes
- Participation in peer code review and technical discussions
- Development of comprehensive benchmarks for I/O functions targeting various storage technologies
- Compatibility and performance optimization across different platforms (Linux, MacOS, and Windows)
- Building reusable software components for a high-quality and maintainable codebase
- Analysis of I/O throughput in a massively parallel and distributed query engine
- Ability to identify and solve inefficiencies in storage-related processes
- Balancing performance, usability, and maintainability across Voltron Data and Apache Arrow ecosystems
- Strong experience in C++ development
Benefits
- Work from Anywhere - Payroll and Benefits in 150+ Countries
- Unlimited PTO
- Medical, Dental, and Vision
- Retirement [USA Only]
- Home Office Budget
- Continuing Education Budget