Computer Vision Algorithm Engineer - TikTok E-commerce Knowledge Graph

$137,750 - $237,500/Yr

Tiktok - Seattle, WA

Full-time - Mid Level

Seattle, WA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

TikTok is the leading destination for short-form mobile video, with a mission to inspire creativity and bring joy. Our team is dedicated to developing state-of-the-art computer vision (CV), natural language processing (NLP), and machine learning (ML) algorithms that enhance user experiences, improve merchant service quality, and foster a thriving ecosystem on our e-commerce platform. Specifically, we focus on the algorithms that power Product Knowledge Graphs within TikTok's global e-commerce business. As a Computer Vision Algorithm Engineer, you will play a crucial role in the development of extensive knowledge graphs that represent real-world products, which are essential for feed ranking, recommendations, and advertisements. You will collaborate closely with product managers, data scientists, and the product strategy and operations team to define product strategies and features that align with our goals. Your responsibilities will include constructing knowledge graphs that encompass product understanding, content feedback, and category/brand construction. You will explore the implementation of Knowledge Graphs and Cognitive Graphs specifically tailored for TikTok's e-commerce shopping guide. Additionally, you will be responsible for mining knowledge related to e-commerce shopping scenes, product matching, and optimizing computer vision models for various e-commerce scenarios, including fine-grain classification and product recognition. You will also work on enhancing the shopping experience through e-commerce short video and livestream classification, multi-modal content mining, and image search algorithms. This position offers the opportunity to work with cutting-edge technology in computer vision, driving the iteration and evolution of algorithms and systems that will significantly impact our e-commerce platform.

Responsibilities

• Participate in the development of massive knowledge graphs of real-world products to support feed ranking, recommendations, and ads.
• Collaborate with product managers, data scientists, and the product strategy & operation team to define product strategies and features.
• Construct knowledge graphs, including product/content/feedback understanding and category/brand/SPU construction.
• Explore the implementation of Knowledge Graph and Cognitive Graph on the e-commerce side of TikTok e-commerce shopping guide.
• Mine e-commerce shopping guide knowledge such as shopping scenes/people/goods matching/product layering.
• Optimize and iterate computer vision related models in the e-commerce scene, including fine grain classification, product object recognition, product subject recognition, feature extraction, logo detection, and brand recognition.
• Classify e-commerce short videos and livestreams, and optimize the shopping experience through multi-modal content mining and understanding.
• Develop algorithms for e-commerce image search and photo search goods, including goods duplication algorithms.
• Explore cutting-edge technology in computer vision and drive the iteration and evolution of overall algorithms and systems.

Requirements

• In-depth knowledge in multimedia and computer vision, including image search, image/video classification and recognition, image segmentation, object detection, OCR, graph neural networks, multimodal, unsupervised and self-supervised learning.
• Familiarity with training and deployment of one or more framework models such as TensorFlow, PyTorch, or MXNet, and understanding of training acceleration methods like hybrid precision training and distributed training.

Benefits

• 100% premium coverage for employee medical insurance
• Approximately 75% premium coverage for dependents
• Health Savings Account (HSA) with company match
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans
• Flexible Spending Account (FSA) options for Health Care, Limited Purpose, and Dependent Care
• 10 paid holidays per year
• 17 days of Paid Personal Time Off (PPTO)
• 10 paid sick days per year
• 12 weeks of paid Parental leave
• 8 weeks of paid Supplemental Disability
• Mental and emotional health benefits through EAP and Lyra
• 401K company match
• Gym and cellphone service reimbursements