Machine Learning Engineer, Amazon General Intelligence (AGI)

About the position

The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Software Development Engineer(SDE)/Machine Learning Engineer(MLE) to play a pivotal role in the development of industry-leading multi-modal and multi-lingual Large Language Models (LLM). As our SDE/MLE superstar, you'll have the power to lead the charge in developing mind-blowing algorithms and modeling techniques that will push the boundaries of large model training using cutting-edge hardware like GPUs and AWS Trainium. Your groundbreaking work will directly impact our customers' lives through game-changing products and services powered by your Generative AI breakthroughs! Get ready to dive into Amazon's vast and diverse data sources and harness the immense power of our large-scale computing resources to turbocharge the development of multi-modal Large Language Models (LLMs) and other awe-inspiring Generative Artificial Intelligence (Gen AI) applications. Your expertise and insights will be invaluable in defining data strategies, enrichment processes, model optimizations, and evaluation methods that will set new standards in the industry! So, if you're passionate about pushing the limits of AI, thrive in a fast-paced and innovative environment, and are ready to make a lasting impact on the world, this is your chance! Join us on this exhilarating adventure and let's revolutionize AGI together! #MLE

Responsibilities

• Ability to quickly learn cutting-edge technologies and algorithms in the field of Generative AI to participate in our journey to build the best LLMs.
• Responsible for the development and maintenance of key platforms needed for developing, evaluating and deploying LLM for real-world applications.
• Work with other team members to investigate design approaches, prototype new technology and evaluate technical feasibility.
• Work closely with Applied scientists to process massive data, scale machine learning models while optimizing.

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language

Nice-to-haves

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Master's degree in computer science or equivalent
• Experience in techniques like kernel fusion and custom kernels to improve GPU utilization, mixed precision training using lower precision and dynamic loss scaling while leveraging hardware specific mixed precision capabilities and/or demonstrated ability to implement efficient memory management like gradient (activation) checkpointing, gradient accumulation, offloading optimizer states, and smart prefetching.

Benefits

• Equity
• Sign-on payments
• Medical benefits
• Financial benefits
• Other benefits