Principal Machine Learning Engineer - Perception

$296,000 - $451,000/Yr

Zoox - Hillsborough, CA

Full-time - Principal

Hillsborough, CA

Administrative and Support Services

About the position

As a Principal ML Engineer in the Perception team, you will lead the development of machine learning algorithms that enhance the understanding of complex environments for autonomous driving. This role involves collaboration across various teams to prototype innovative solutions that influence the technical direction of the organization. You will work with cutting-edge sensor data and infrastructure to create algorithms for segmentation, tracking, classification, and scene understanding, impacting both immediate milestones and long-term exploratory projects.

Responsibilities

• Develop new algorithms to understand the scene around the robot and how that scene would evolve through time.
• Build multi-modal foundation models for on-vehicle and offline applications.
• Develop new algorithms to apply generative AI to simulation to improve the realism of offline validation systems.
• Leverage large-scale machine learning infrastructure to discover new solutions and push the boundaries of the field.
• Provide technical mentorship to the broader group of ML developers at Zoox.
• Collaborate with engineers on Prediction, Planning, and Simulation to solve the overall Autonomous Driving problem in complex urban environments.

Requirements

• BS, MS, or PhD degree in computer science or related field.
• Experience with training and deploying Deep Learning models on sensor data.
• Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines.
• Experience with modern computer vision techniques.
• Strong mathematical skills and understanding of probabilistic techniques.
• Fluency in C++ or Fluency in Python with a basic understanding of C++.
• Extensive experience with programming and algorithm design.

Nice-to-haves

• Publications in your field (CVPR, ICCV, RSS, ICRA preferred).
• Experience with autonomous robots.
• Experience with realtime sensor fusion (e.g., LiDAR, camera, radar).
• Experience with novel pipelines and architectures for convolutional neural nets.
• Experience with 3D data and representations (pointclouds, meshes, etc.).

Benefits

• Paid time off (e.g., sick leave, vacation, bereavement).
• Unpaid time off.
• Zoox Stock Appreciation Rights.
• Amazon RSUs.
• Health insurance.
• Long-term care insurance.
• Long-term and short-term disability insurance.
• Life insurance.