Research Scientist, ML H/W-SW Codesign

$177,000 - $251,000/Yr

Meta - Sunnyvale, CA

Full-time - Mid Level

Sunnyvale, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

Meta is seeking a Research Scientist to join its Reality Labs team, focusing on machine learning hardware-software co-design. The role involves developing innovative solutions for compute and power-efficient training and inference of vision and language models for augmented and virtual reality applications. The ideal candidate will leverage their expertise in AI models, hardware acceleration, and software systems to tackle complex challenges in the field.

Responsibilities

• Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture and AR/VR use cases.
• Work across hardware and software to solve deep co-design problems with other Research scientists.
• Codesign and invent novel ML accelerator and system architecture solutions, facilitating the integration of algorithms and software.
• Develop state-of-the-art model compression and scalability techniques using numerics, pruning, distillation, etc.
• Optimize models on hardware accelerators to achieve the best performance given various real-time latency and power constraints.
• Influence partners to deliver impact through deep, thorough data-driven analysis.
• Define use cases, and develop methodology & benchmarks to evaluate different approaches.
• Maintain in-depth knowledge of how ML acceleration interacts with other systems.
• Attend conferences, interpret papers, and stay updated with the latest research advancements in ML acceleration.
• Patent and/or publish novel outcomes in peer-reviewed conferences and journals.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD in Electrical Engineering, Computer Science or equivalent experience.
• 2+ years of specialized experience in machine learning/deep learning domains such as model compression, hardware-aware model optimizations, hardware accelerators architecture, GPU architecture, machine learning compilers, or ML systems.
• Experience developing AI-System infrastructure, AI algorithms or AI hardware acceleration in C/C++ or Python.

Nice-to-haves

• Experience or knowledge of training/inference of large scale AI models - CV and/or LLMs.
• Experience or knowledge of architecting ML hardware accelerators and systems.
• Experience or knowledge of on-device algorithm development including hardware-aware ML models and/or optimizing ML compilers for efficient deployment on AI accelerators.
• Experience with PyTorch, TensorFlow or similar machine learning toolsets.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, and publications at leading workshops, journals or conferences.

Benefits

• Competitive salary ranging from $177,000 to $251,000 per year, plus bonus and equity.
• Comprehensive health insurance coverage.
• 401(k) retirement savings plan with company matching contributions.
• Paid time off and holidays.
• Flexible work hours and remote work options.
• Professional development opportunities and continued education support.