Machine Learning Engineer, Multimodality

$113,500 - $355,000/Yr

Tiktok - San Jose, CA

Full-time - Mid Level

San Jose, CA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The position is focused on building and enhancing risk control systems at TikTok, utilizing advanced technologies such as AIGC models, deep learning, and machine learning. The role involves understanding advertisement content and constructing models to improve inference efficiency while ensuring high performance and reliability. The Business Integrity team is dedicated to creating a safe and trusted environment for users, making this role crucial for maintaining the integrity of TikTok's commercial products.

Responsibilities

• Understand content of advertisements, including titles, images, videos, OCR texts, ASR texts, etc.
• Construct models such as AIGC model, image/video model, multimodality model, etc.
• Improve inference efficiency while maintaining the effectiveness of models through model acceleration.
• Track and implement state-of-the-art technologies in computer vision and multimodality.

Requirements

• Excellent algorithm foundation and programming ability, familiar with mainstream programming languages such as Python/C++.
• Familiar with model training frameworks, such as TensorFlow, PyTorch, MXNet, etc.
• Proficiency in building or fine-tuning large language models (LLMs) at scale, with experience in computer vision (CV), natural language processing (NLP), or text/audio technologies.

Nice-to-haves

• Familiar with NLP-related tasks, such as text classification, keyword matching, and large language models (LLM).
• Familiar with CV-related tasks, such as image/video classification, object detection, and retrieval.
• Familiar with multimodality technologies, such as vision-language pretraining.
• Bachelor's degree or above in Computer Science, Computer Engineering, Electrical Engineering, or related fields.
• Experience in Gen-AI or AIGC models is preferred.
• Published papers in relevant conferences such as CVPR, ICCV, ECCV, ICML, NeurIPS, ACL, EMNLP, etc.

Benefits

• 100% premium coverage for employee medical insurance, approximately 75% for dependents, and a Health Savings Account (HSA) with company match.
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans.
• 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO) and 10 paid sick days per year.
• 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.
• Mental and emotional health benefits through EAP and Lyra.
• 401K company match, gym and cellphone service reimbursements.