Senior Machine Learning Engineer, Generative AI

Amazon - Boston, MA

Full-time

Boston, MA

Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers

About the position

The position involves working on advanced runtime systems that host cutting-edge Large Language Models (LLMs) in a fast-paced and dynamic environment. The role focuses on rapidly experimenting and delivering scalable runtime solutions based on the latest research and experiments in the LLM space.

Responsibilities

• Design, develop, test and deploy inference solutions for high-end LLMs
• Explore emerging inference optimization techniques
• Collaborate with cross-functional teams of engineers and scientists to identify and solve complex problems
• Mentor and guide junior engineers, and contribute to the overall growth and development of the team

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team

Nice-to-haves

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Benefits

• Diverse and inclusive workplace
• Equal opportunity employer