Software Engineer, Deep Learning

$140,000 - $250,000/Yr

Pony.Ai - Fremont, CA

Full-time - Entry Level

Fremont, CA

Publishing Industries

About the position

The Software Engineer, Deep Learning position at Pony.ai involves working with experts in autonomous mobility to design and develop software architecture and deep learning models for self-driving vehicles. The role focuses on creating large-scale foundation models, applying machine learning techniques to real-world problems, and optimizing models for real-time applications.

Responsibilities

• Work with experts in the field of self-driving vehicles on software architecture and design, system and module design, evaluation metrics, specification and implementation of test and regression frameworks.
• Design and develop large-scale foundation models trained on vast amounts of real-world data.
• Frame open-ended real-world problems into well-defined ML problems; develop and apply cutting-edge ML approaches (deep learning, reinforcement learning, imitation learning, etc.) to these problems; scale them to data pipelines; and streamline them to run in real-time on the cars.
• Develop and deploy deep learning models, including vision language models (VLMs) and Large Language Models (LLMs).
• Optimize deep learning models to run robustly under tight run-time constraints.

Requirements

• Master in Computer Science, or at least 2 years of equivalent industry experience in similar technical fields.
• Solid understanding of data structures, algorithms, parallel computing, code optimization and large scale data processing.
• Experience in applied machine learning including data collection and analysis, evaluation and feature engineering.
• Expertise in C++/Python.
• Strong communication skills and team spirit.

Nice-to-haves

• PhD in Deep Learning, Machine Learning, Robotics, Natural Language Processing, or similar technical field of study.
• Publications on top-tier conferences like CVPR/ICCV/ECCV/ICLR/ICML/NeurIPS/ICLR/AAAI/IJCV/PAMI.
• Experience in applying ML/DL for behavior prediction, imitation learning, motion planning.
• Experience in deploying deep learning algorithms for real-time applications, with limited computing resources.
• Experience in convex optimization, computational geometry or linear algebra.
• Experience in GPU/CUDA/TensorRT.

Benefits

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (Traditional and Roth 401k)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Free Food & Snacks