Data Engineer, Research Tools

$300,000 - $340,000/Yr

Anthropic - San Francisco, CA

Full-time - Mid Level

San Francisco, CA

About the position

As a Data Engineer on the Research Tools team at Anthropic, you will be responsible for building and maintaining the critical algorithms and infrastructure that support the training of AI models. Your work will focus on enhancing the performance, robustness, and usability of these systems, directly contributing to breakthroughs in AI capabilities and safety. You will collaborate closely with researchers to implement advanced techniques and improve the systems that enable efficient model training.

Responsibilities

• Build, maintain, and improve algorithms and systems for training AI models.
• Enhance the speed, reliability, and usability of training systems.
• Profile reinforcement learning pipelines to identify improvement opportunities.
• Develop systems for launching training jobs in test environments to quickly detect issues.
• Modify finetuning systems to accommodate new model architectures.
• Create instrumentation to detect and eliminate Python GIL contention in training code.
• Diagnose and resolve performance issues in training runs.
• Implement stable and fast versions of new training algorithms.

Requirements

• 2+ years of software engineering experience.
• Experience with high performance, large scale distributed systems.
• Proficiency in Kubernetes and Python.
• Familiarity with implementing LLM finetuning algorithms, such as RLHF.

Nice-to-haves

• Experience with machine learning research.
• Strong results-oriented mindset with flexibility and impact focus.
• Enjoyment of pair programming.

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents.
• 401(k) plan with 4% matching.
• 22 weeks of paid parental leave.
• Unlimited PTO, with most staff taking 4-6 weeks each year.
• Stipends for education, home office improvements, commuting, and wellness.
• Fertility benefits via Carrot.
• Daily lunches and snacks in the office.
• Relocation support for those moving to the Bay Area.