Senior Research Scientist, Intelligent Editing (Multimodality)

$199,500 - $340,100/Yr

Tiktok - Seattle, WA

Full-time - Senior

Seattle, WA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

As a Senior Research Scientist in Intelligent Editing at TikTok, you will be at the forefront of cutting-edge research and development in the fields of computer vision and machine learning. This role focuses particularly on multi-modal understanding, which encompasses the integration of vision and language, as well as large-scale training methodologies. You will be responsible for conducting innovative research that pushes the boundaries of what is possible in AI technology, specifically in the context of video and audio content creation. Your work will involve transferring advanced technologies into ByteDance products, ensuring that our offerings remain at the leading edge of the industry. Additionally, you will explore new product opportunities that leverage artificial intelligence at their core, contributing to the evolution of TikTok's platform and enhancing user experiences. The Intelligent Creation Team, which you will be a part of, is dedicated to developing AI, special effects, and audio-video creation technologies. This team is responsible for a wide array of technical fields, including deep learning, computer vision, graphics, and speech processing. You will collaborate with team members to provide cutting-edge content understanding and creation capabilities, as well as interactive experiences that can be utilized across various business lines within TikTok and by external partners. Your contributions will not only impact the technology but also the creative processes of millions of users worldwide, making this a highly impactful role within the organization.

Responsibilities

• Conduct cutting-edge research and development in computer vision and machine learning, especially in the areas of multi-modal understanding, vision and language, large-scale training, etc.
• Transfer advanced technologies to ByteDance products.
• Explore new products with artificial intelligence technology at its core.

Requirements

• At least 3 years of research and practical experience in one or more areas of computer vision, including but not limited to multimodal understanding, vision and language, and large-scale training.
• Experience in multimodal understanding, such as video highlight detection and slicing, audio/music understanding, etc.
• Experience in vision and language, such as image/video captioning, retrieval, VQA, and other related fields.
• Experience with language models and applying them in various downstream tasks, especially for intelligent editing.
• Experience in large-scale training and RLHF.
• Publications in top-tier venues such as CVPR, ECCV, ICCV, NeurIPS, ICLR, ICML or ACL, EMNLP, COLING, etc. are preferred.
• Highly competent in algorithms and programming; Strong coding skills in C/C++ and Python.
• Ability to work and collaborate well with team members.
• Ability to work independently.

Benefits

• 100% premium coverage for employee medical insurance
• Approximately 75% premium coverage for dependents
• Health Savings Account (HSA) with company match
• Dental insurance
• Vision insurance
• Short/Long term Disability insurance
• Basic Life insurance
• Voluntary Life and AD&D insurance plans
• Flexible Spending Account (FSA) options for healthcare and dependent care
• 10 paid holidays per year
• 17 days of Paid Personal Time Off (PPTO)
• 10 paid sick days per year
• 12 weeks of paid Parental leave
• 8 weeks of paid Supplemental Disability
• Mental and emotional health benefits through EAP and Lyra
• 401K company match
• Gym reimbursement
• Cellphone service reimbursement