Software Development Engineer, Open Data Analytics Engines - Spark

$129,300 - $223,600/Yr

Amazon - East Palo Alto, CA

Full-time - Mid Level

East Palo Alto, CA

Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers

About the position

The Software Development Engineer for Open Data Analytics Engines - Spark will be a key member of the analytics team, focusing on enhancing the performance and scalability of analytics engines like Trino and Spark. This role involves hands-on development, design, and implementation of critical features and optimizations for query engines, contributing to a strategic area within AWS that has seen significant improvements in the last few years.

Responsibilities

• Hands-on development for core components of the query engine
• Design and develop solutions and algorithms to improve the performance of Spark
• Design and develop improvements to the AWS Runtime for Spark's integration with other AWS services
• Manage complex deliverables project and research projects with deadlines
• Ensure data consistency and durability with breakthrough performance and scalability
• Interact and partner with the open source community

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience of new and existing systems
• Experience programming with at least one software programming language

Nice-to-haves

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Benefits

• Flexible work culture
• Diversity and inclusion initiatives
• Mentorship and career growth opportunities