Machine Learning Systems Engineer, RL Engineering

$62,400 - $300,000/Yr

Anthropic Pbc - San Francisco, CA

Full-time - Mid Level

San Francisco, CA

About the position

As a Machine Learning Systems Engineer on the Reinforcement Learning Engineering team at Anthropic, you will be responsible for developing and maintaining the critical algorithms and infrastructure that support the training of AI models. Your role will focus on enhancing the performance, robustness, and usability of these systems, enabling breakthroughs in AI capabilities and safety. You will work closely with researchers to improve the systems used for training models, ensuring they are efficient and effective in their operations.

Responsibilities

• Build, maintain, and improve algorithms and systems for training AI models.
• Profile the reinforcement learning pipeline to identify improvement opportunities.
• Develop a system for launching training jobs in a test environment to quickly detect issues.
• Modify finetuning systems to accommodate new model architectures.
• Create instrumentation to detect and eliminate Python GIL contention in training code.
• Diagnose and resolve performance issues in training runs.
• Implement stable and fast versions of new training algorithms proposed by researchers.

Requirements

• 2+ years of software engineering experience.
• Experience with high performance, large scale distributed systems.
• Proficiency in Kubernetes and Python.
• Familiarity with implementing LLM finetuning algorithms, such as RLHF.

Nice-to-haves

• Experience with machine learning research.
• Strong results-oriented mindset with flexibility and impact.
• Enjoyment of pair programming.

Benefits

• Comprehensive health, dental, and vision insurance for you and all your dependents.
• 401(k) plan with 4% matching.
• 22 weeks of paid parental leave.
• Unlimited PTO, with most staff taking between 4-6 weeks each year.
• Stipends for education, home office improvements, commuting, and wellness.
• Fertility benefits via Carrot.
• Daily lunches and snacks in the office.
• Relocation support for those moving to the Bay Area.