AIML - Machine Learning Engineer, Foundation Model Services

$175,800 - $312,200/Yr

Apple - Cupertino, CA

Full-time - Senior

Cupertino, CA

Computer and Electronic Product Manufacturing

About the position

The position is focused on optimizing and deploying large-scale machine learning models within Apple's Foundation Model Services team. This role involves collaborating with product teams to create production-grade solutions that serve millions of customers in real-time, while also mentoring engineers and developing tools to identify bottlenecks in inference across various hardware and use cases.

Responsibilities

• Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting edge model architectures.
• Build tools to understand bottlenecks in inference for different hardwares and use cases.
• Mentor and guide engineers in the organization.

Requirements

• 8+ years of experience leading and driving complex, ambiguous projects.
• Strong industry background and experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics).
• Rich experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Proficient in building and maintaining systems written in modern languages (e.g., Golang, Python).

Nice-to-haves

• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.
• Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses including tuition
• Discretionary bonuses or commission payments
• Relocation assistance