Research Scientist, ML H/W-SW Codesign

$177,000 - $251,000/Yr

Meta - Austin, TX

Full-time - Senior

Austin, TX

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

Meta is seeking a Research Scientist specializing in ML H/W-SW Codesign to join its Reality Labs team. This role focuses on developing innovative solutions for compute and power-efficient training and on-device inference of vision and language models, particularly for Augmented Reality (AR) and Virtual Reality (VR) applications. The ideal candidate will leverage their expertise in AI models, hardware acceleration, and software systems to tackle complex challenges in the field, contributing to the advancement of custom silicon technologies that enhance AR and VR experiences.

Responsibilities

• Identify and solve multi-discipline ML acceleration problems involving algorithms, network design, hardware architecture, and AR/VR use cases.
• Work across hardware and software to solve deep co-design problems with other research scientists.
• Codesign and invent novel ML accelerator and system architecture solutions, facilitating the integration of algorithms and software.
• Develop state-of-the-art model compression and scalability techniques using numerics, pruning, and distillation.
• Optimize models on hardware accelerators to achieve the best performance under real-time latency and power constraints.
• Influence partners to deliver impact through thorough data-driven analysis.
• Define use cases and develop methodology and benchmarks to evaluate different approaches.
• Apply in-depth knowledge of ML acceleration interactions with surrounding systems.
• Attend conferences, interpret papers, and stay updated with the latest research advancements in ML acceleration.
• Patent and/or publish novel outcomes in peer-reviewed conferences and journals.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
• PhD in Electrical Engineering, Computer Science, or equivalent experience.
• 2+ years of specialized experience in machine learning/deep learning domains such as model compression, hardware-aware model optimizations, or ML systems.
• Experience developing AI-System infrastructure, AI algorithms, or AI hardware acceleration in C/C++ or Python.

Nice-to-haves

• Experience or knowledge of training/inference of large-scale AI models, including computer vision and large language models.
• Experience architecting ML hardware accelerators and systems.
• Experience with on-device algorithm development and optimizing ML compilers for AI accelerators.
• Familiarity with machine learning toolsets like PyTorch and TensorFlow.
• Proven track record of significant results demonstrated by grants, fellowships, patents, or publications at leading conferences.

Benefits

• Competitive salary ranging from $177,000 to $251,000 per year, plus bonus and equity.
• Comprehensive health insurance coverage.
• 401(k) retirement savings plan with company matching.
• Paid time off and holidays.
• Opportunities for professional development and continued education.