Research Scientist Intern, Systems ML and HPC - SW/HW Co-Design

Meta - Menlo Park, CA

Full-time - Intern

Menlo Park, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The Research Scientist Intern position within the AI System SW/HW Co-design team at Meta focuses on exploring and developing high-performance software and hardware technologies for AI at datacenter scale. The intern will work on optimizing machine learning workloads, enhancing performance, and collaborating with various engineering teams to ensure efficient infrastructure for large-scale Generative AI and recommendation systems.

Responsibilities

• Develop tools and methodologies for large scale workload analysis and extract representative benchmarks in C++/Python/Hack.
• Analyze evolving Meta workload trends and business needs to derive requirements for future offerings.
• Utilize understanding of CPUs, Flash/HDD storage systems, networking, and GPUs to identify bottlenecks and enhance efficiency.
• Collaborate with software developers to re-architect services, improve codebase, and identify hardware/software co-design opportunities.
• Identify industry trends and conduct prototyping exercises to quantify value propositions for Meta.
• Work with various engineering teams to deliver the hardware roadmap into production.

Requirements

• Currently pursuing a PhD degree in Computer Science or a related STEM field.
• Experience with hardware architecture, compute technologies, and/or storage systems.
• Must obtain work authorization in the country of employment at the time of hire and maintain it during employment.
• Intent to return to degree program after the internship.

Nice-to-haves

• Track record of achieving results demonstrated by grants, fellowships, patents, or publications at leading workshops or conferences.
• Architectural understanding of CPU, GPU, Accelerators, Networking, Flash/HDD Storage systems.
• Experience with distributed AI training and inference focusing on performance and efficiency.
• Experience with large-scale infrastructure and distributed systems.
• Knowledge in developing and debugging in C/C++, Python, and/or PyTorch.
• Experience in theoretical and empirical research.

Benefits

• Compensation of $7,500/month to $11,333/month
• Equal Employment Opportunity and Affirmative Action employer
• Reasonable accommodations for candidates with disabilities