Staff Software Engineer, ML Data Platform

$175,100 - $257,500/Yr

Gm Cruise - San Francisco, CA

Full-time - Senior

San Francisco, CA

Transportation Equipment Manufacturing

About the position

As an engineer at Cruise, you will play a pivotal role in building and supporting a petabyte-scale data platform in the cloud, which serves as the foundation for Cruise's machine learning data tools, frameworks, and services. This position focuses on ensuring scalable, transparent, and reliable data ingestion and management, as well as developing robust data processing tools and orchestration for large-scale computational pipelines.

Responsibilities

• Lead the development, optimization, and productionization of the next generation data processing platform using Beam and Spark in the cloud.
• Build self-serve capabilities to help customers adopt the next generation data processing platform.
• Design, implement, and test scalable distributed data systems in the cloud using the latest cloud technologies.
• Champion engineering excellence by continuously improving systems and processes.
• Own technical projects from start to finish and contribute to the team's product roadmap.
• Participate in team planning, code reviews, and design discussions.
• Manage conflicts and consider the effects of projects across multiple teams.
• Collaborate with partner teams to achieve cross-organizational goals.
• Conduct technical interviews and play a role in recruiting activities.
• Onboard and mentor junior engineers and interns.

Requirements

• Experience building a data processing system using Beam/Spark and its ecosystems from the ground up.
• Experience optimizing data processing clusters for cost efficiency and performance.
• Experience building serving systems capable of delivering data at high-throughput, low-latency, and high QPS in a cost-efficient manner.
• Experience building full ML model lifecycle solutions from feature engineering to deployment and monitoring.
• Experience building scalable infrastructure on the cloud with Python or Java/Scala (or similar).
• 10+ years working with big data.
• BS, MS, or Ph.D. in Computer Science, Electrical Engineering, Mathematics, Physics, or a relevant field; or equivalent real-world experience.
• Passionate about self-driving technology and its potential impact on the world.
• Attention to detail and a passion for seeking truth.
• A track record of efficiently solving complex problems.
• Startup mentality - openness to dealing with unknown unknowns and wearing many hats.

Nice-to-haves

• Demonstrable expertise in building end-to-end data ingestion, processing, and serving systems at petabyte scale from the ground up.
• Proficiency in writing SQL queries for analytic purposes.
• Relevant publications.

Benefits

• Competitive salary and benefits
• Medical / dental / vision insurance
• Life and AD&D insurance
• Subsidized mental health benefits
• Paid time off and holidays
• Paid parental, medical, family care, and military leave of absence
• 401(k) Cruise matching program
• Fertility benefits
• Dependent Care Flexible Spending Account
• Flexible Spending Account & Health Saving Account
• Perks Wallet program for benefits/perks
• Pre-tax Commuter benefit plan for local employees
• CruiseFlex, our location-flexible work policy.