Large Model System Engineer, TikTok Multimedia Arch

$194,000 - $355,000/Yr

Tiktok - San Jose, CA

Full-time - Mid Level

San Jose, CA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

TikTok is the leading destination for short-form mobile video, and our mission is to inspire creativity and bring joy. We are seeking passionate individuals to explore innovative applications and solutions for large models in TikTok multimedia, including video, images, and audio. In this role, you will design and develop state-of-the-art deep learning engineering optimization solutions to support model development and iteration in content understanding and generative AI. Your primary focus will be on optimizing end-to-end efficiency in model training and inference, which includes data management, training/inference acceleration, resource utilization enhancement, distributed training support for large-scale models, model architecture optimization, and model compression. You will also be responsible for communicating and collaborating with colleagues in cross-functional teams to improve models, algorithms, and engineering infrastructures. Additionally, you will provide AI solutions for multimedia business scenarios across all TikTok products, such as streaming media transmission, image/video/audio creation, and content consumption. This position is integral to our mission of creating a platform that helps imaginations thrive and drives impact for our company and the communities we serve.

Responsibilities

• Design and develop deep learning engineering optimization solutions for content understanding and generative AI.
• Optimize end-to-end efficiency in model training and inference, including data management and training/inference acceleration.
• Enhance resource utilization and support distributed training for large-scale models.
• Collaborate with cross-functional teams to improve models, algorithms, and engineering infrastructures.
• Provide AI solutions for multimedia business scenarios across TikTok products.

Requirements

• Proficient in one or more programming languages such as Python, C, or C++.
• Familiar with common data structures and basic algorithms.
• Knowledge of computer architecture and operating systems, with a background in distributed systems and design patterns.
• Experience with open-source deep learning frameworks like TensorFlow, PyTorch, or Paddle, and understanding their underlying design.
• Strong problem-solving and analytical skills, with a sense of responsibility.

Nice-to-haves

• Experience in large-scale distributed machine learning and parallel training.
• Familiarity with distributed data processing frameworks like Hadoop/Spark.
• Experience in developing open-source algorithm frameworks in areas such as computer vision, natural language processing, or speech.
• Experience in deep learning model acceleration and engineering implementation.

Benefits

• 100% premium coverage for employee medical insurance, approximately 75% for dependents.
• Health Savings Account (HSA) with company match.
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans.
• Flexible Spending Account (FSA) options for healthcare and dependent care.
• 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO).
• 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.
• Mental and emotional health benefits through EAP and Lyra.
• 401K company match, gym and cellphone service reimbursements.