Research Scientist Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (PhD)

$124,800 - $124,800/Yr

Bytedance - San Jose, CA

Full-time - Intern

San Jose, CA

Professional, Scientific, and Technical Services

About the position

The Research Scientist Intern position at ByteDance's Doubao (Seed) Team focuses on developing advanced machine learning systems. This internship offers an opportunity to engage in cutting-edge research in AI, particularly in areas such as natural language processing, computer vision, and speech recognition. Interns will work on optimizing machine learning frameworks and contribute to the development of efficient training systems for large-scale models. The role is designed for PhD students looking to gain hands-on experience in a dynamic and innovative environment.

Responsibilities

• Research and develop efficient machine learning systems, including optimizers and gradient efficient training techniques.
• Develop a state-of-the-art asynchronous training framework ensuring convergence.
• Implement general purpose training framework features and model-specific optimizations.
• Improve efficiency and stability for large scale distributed training jobs.

Requirements

• Currently enrolled in a PhD program focusing on distributed and parallel computing principles.
• Familiarity with machine learning algorithms and frameworks such as PyTorch and Jax.
• Basic understanding of GPU and/or ASIC operations.
• Proficiency in at least one or two programming languages in a Linux environment, such as C/C++, CUDA, or Python.
• Must obtain and maintain work authorization in the country of employment.

Nice-to-haves

• Experience with GPU-based high performance computing and RDMA high performance networks.
• Familiarity with distributed training framework optimizations like DeepSpeed and Megatron.
• Knowledge of AI compiler stacks such as torch.fx and MLIR.
• Experience in large scale data processing and parallel computing.
• Experience in designing and operating large scale systems in cloud computing or machine learning.
• In-depth CUDA programming and performance tuning experience.

Benefits

• Hourly rate of $60 for interns.
• 100% premium coverage for full-time intern medical insurance after 90 days.
• Paid holidays and paid sick leave.
• Mental and emotional health benefits through the Employee Assistance Program.
• Reimbursement for mobile phone expenses.