AIML - Machine Learning Engineer, Foundation Model Services

$166,600 - $296,300/Yr

Apple - Seattle, WA

Full-time - Senior

Seattle, WA

Computer and Electronic Product Manufacturing

About the position

The role is focused on optimizing and deploying machine learning models at scale within Apple's Foundation Model Services team. This position involves collaborating with product teams to create production-grade solutions that serve millions of customers in real-time, while also mentoring engineers and developing tools to identify bottlenecks in inference across various hardware and use cases.

Responsibilities

• Work closely with product teams to build production grade solutions to launch models serving millions of customers in real time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting edge model architectures.
• Build tools to understand bottlenecks in inference for different hardwares and use cases.
• Mentor and guide engineers in the organization.

Requirements

• 8+ years of experience leading and driving complex, ambiguous projects.
• Strong industry background and experience in ML technologies (LLMs, Machine Learning, NLP, Information Retrieval, Statistics).
• Rich experience with high throughput services particularly at supercomputing scale.
• Proficient with running applications on Cloud (AWS / Azure or equivalent) using Kubernetes, Docker etc.
• Proficient in building and maintaining systems written in modern languages (e.g., Golang, Python).

Nice-to-haves

• Familiar with one of the popular ML Frameworks like Pytorch, Tensorflow.
• Familiar with fundamental Deep Learning architectures such as Transformers, Encoder/Decoder models.
• Familiarity with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server etc.

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• Discounted products and free services
• Reimbursement for certain educational expenses including tuition
• Discretionary bonuses or commission payments
• Relocation assistance