Senior Software Engineer - AI, Artificial General Intelligence | Inference Engines

$151,300 - $261,500/Yr

Amazon - Boston, MA

Full-time - Senior

Boston, MA

Sporting Goods, Hobby, Musical Instrument, Book, and Miscellaneous Retailers

About the position

The Senior Software Engineer - AI position focuses on advancing Amazon's generative AI technologies, particularly through the development of inference engines that support multimodal Large Language Models. The role involves leveraging advanced hardware and innovative software architecture to drive research and product development, establishing Amazon as a leader in enterprise AI solutions.

Responsibilities

• Develop, improve, and release cutting-edge inference engines.
• Lead efforts to optimize inference performance on custom AWS Trainium and Inferentia silicon and Trn1, Inf1/2 servers.
• Utilize strong software development skills in Python and C++ along with Machine Learning knowledge to enhance inference runtime.
• Understand current and future directions of ML framework development to enable efficient inference.

Requirements

• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years of experience leading design or architecture of new and existing systems.
• 5+ years of experience in the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Experience as a mentor, tech lead, or leading an engineering team.
• Fundamentals of machine learning and prevalent model architectures including Transformers.

Nice-to-haves

• Bachelor's degree in computer science or equivalent.

Benefits

• Competitive salary based on market location and experience.
• Equity and sign-on payments may be provided as part of the total compensation package.
• Full range of medical, financial, and other benefits.