Senior Query Optimization Engineer

We are seeking a highly motivated Senior Query Optimization Engineer to join our team at Voltron Data. In this role, you will have the opportunity to contribute to the growth and support of the Voltron Data and Apache Arrow ecosystems. Your main responsibility will be to collaborate with our development teams in building and maintaining a SQL parser and query optimizer for large-scale single node and distributed query execution engines. This position offers the chance to work on cutting-edge technology and make a significant impact in the field of data analytics.

• Build and maintain a SQL parser and query optimizer for large scale single node and distributed query execution engines
• Learn about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components
• Familiarize yourself with the different partners for compute kernels and the query execution engine on Apache Arrow
• Embrace the Apache development process
• Benchmark queries and explore the effects of different query optimization techniques using the query optimizer
• Make changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development
• Add new query optimization rules
• Make improvements to decision making in the cost based optimization based on metadata availability for the tables being queried
• Integrate non-SQL operations to the optimization framework
• Work with client interfacing engineers to understand performance bottlenecks in customer queries
• Propose and implement improvements to the query parsing and optimization framework
• Integrate with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways

• Highly motivated Senior Query Optimization Engineer
• Experience in building and maintaining a SQL parser and query optimizer for large scale single node and distributed query execution engines
• Familiarity with Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components
• Knowledge of different partners for compute kernels and the query execution engine on Apache Arrow
• Understanding and embracing the Apache development process
• Proficiency in benchmarking queries and exploring the effects of different query optimization techniques
• Ability to make changes and improvements to existing query optimization rules and physical execution plans
• Capability to add new query optimization rules
• Experience in decision making in cost-based optimization based on metadata availability for queried tables
• Integration of non-SQL operations to the optimization framework
• Collaboration with client interfacing engineers to identify performance bottlenecks in customer queries
• Proposal and implementation of improvements to the query parsing and optimization framework
• Integration with a stateful inter-query query engine context to optimize the reusability of compute stages across similar queries

• Work from Anywhere - Payroll and Benefits in 150+ Countries
• Unlimited PTO
• Medical, Dental, and Vision
• Retirement [USA Only]
• Home Office Budget
• Continuing Education Budget