Research Scientist, Systems ML and HPC - SW/HW Co-Design

Meta - Bellevue, WA

Full-time - Entry Level

Bellevue, WA

5,001-10,000 employees

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

Meta is seeking a Research Scientist to join our Research & Development teams, focusing on AI Infrastructure. The role involves applying industry experience to solve critical problems in hardware/software for AI Training, working across multiple teams to enhance scalability, reliability, and performance of large-scale distributed training systems. The position encompasses optimizing compute efficiency, innovating model architecture, and co-designing learning algorithms to improve training convergence. The candidate will also engage in maximizing training performance for Generative AI and recommendation models on custom hardware, while collaborating with various teams to ensure end-to-end performance of large-scale training.

Responsibilities

• Apply High-Performance Computing (HPC) algorithms and techniques to optimize large-scale AI workloads
• Analyze, benchmark, and optimize large-scale workloads on next-generation training superclusters
• Apply relevant AI infrastructure and software/hardware acceleration techniques to build and optimize intelligent ML systems
• Influence next-generation model and hardware architecture choices by projecting training performance and model efficiency
• Set goals related to project impact, AI system design, and infrastructure/developer efficiency
• Drive large projects across multiple teams
• Define use cases and develop methodology and benchmarks to evaluate different approaches
• Apply in-depth knowledge of how ML infrastructure interacts with surrounding systems
• Develop systems software related to collective communications.

Requirements

• Currently has, or is in the process of obtaining, a Master's/PhD degree in Computer Science, Computer Vision, Generative AI, NLP, or a relevant technical field
• Currently has, or is in the process of obtaining, a Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field
• Specialized experience in high-performance computing, performance optimizations, SW/HW co-design, hardware accelerators architecture, GPU architecture, machine learning compilers, ML systems, AI infrastructure, or machine learning frameworks
• Experience developing AI system infrastructure or AI algorithms in C/C++ or Python
• Must obtain work authorization in the country of employment at the time of hire.

Nice-to-haves

• Experience or knowledge of training/inference of large-scale AI models
• Experience or knowledge of distributed and cloud systems
• Experience or knowledge in recommendation and ranking models, LLM and/or LDM, or Collective Communication libraries.

Benefits

• Equity
• Bonus
• Health benefits
• Flexible working hours
• Professional development opportunities