Research Scientist, Systems ML and HPC - SW/HW Co-Design

$117,000 - $173,000/Yr

Meta - Menlo Park, CA

Full-time - Entry Level

Menlo Park, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

Meta is seeking a Research Scientist to join its Research & Development teams, focusing on AI Infrastructure. The role involves applying expertise in hardware/software co-design to address critical challenges in AI training, optimizing large-scale distributed systems, and innovating model architectures for enhanced efficiency. The position is integral to advancing Meta's capabilities in generative AI and recommendation models, working collaboratively across multiple teams to maximize training performance and ensure the delivery of cutting-edge AI experiences.

Responsibilities

• Apply High-Performance Computing (HPC) algorithms and techniques to optimize large-scale AI workloads
• Analyze, benchmark, and optimize large-scale workloads on next-generation training superclusters
• Apply relevant AI infrastructure and software/hardware acceleration techniques to build and optimize intelligent ML systems
• Influence next-generation model and hardware architecture choices by projecting training performance and model efficiency
• Goal-setting related to project impact, AI system design, and infrastructure/developer efficiency
• Drive large projects across multiple teams
• Define use cases and develop methodology and benchmarks to evaluate different approaches
• Apply in-depth knowledge of how ML infrastructure interacts with other systems.

Requirements

• Currently has, or is in the process of obtaining, a Master's/PhD degree in Computer Science, Computer Vision, Generative AI, NLP, or a relevant technical field
• Specialized experience in machine learning/deep learning domains such as high-performance computing, performance optimizations, SW/HW co-design, hardware accelerators architecture, GPU architecture, machine learning compilers, ML systems, AI infrastructure, or machine learning frameworks (e.g. PyTorch)
• Experience developing AI system infrastructure or AI algorithms in C/C++ or Python
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.

Nice-to-haves

• Experience or knowledge of training/inference of large-scale AI models
• Experience or knowledge of distributed and cloud systems
• Experience or knowledge in recommendation and ranking models, LLM and/or LDM, or Collective Communication libraries (NCCL or RCCL)

Benefits

• Competitive salary ranging from $117,000 to $173,000 per year
• Bonus opportunities
• Equity options
• Comprehensive benefits package