Computer Vision Algorithm Engineer - TikTok E-commerce Knowledge Graph

$145,000 - $250,000/Yr

Tiktok - San Jose, CA

Full-time - Mid Level

San Jose, CA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

TikTok is the leading destination for short-form mobile video, with a mission to inspire creativity and bring joy to over 1 billion users globally. Our team is dedicated to developing state-of-the-art computer vision (CV), natural language processing (NLP), and machine learning (ML) algorithms that enhance user experiences, improve merchant service quality, and foster a thriving ecosystem on our e-commerce platform. Specifically, we focus on the algorithms that power Product Knowledge Graphs within TikTok's global e-commerce business. As a Computer Vision Algorithm Engineer, you will play a crucial role in the development of extensive knowledge graphs that represent real-world products, which are essential for feed ranking, recommendations, and advertisements. You will collaborate closely with product managers, data scientists, and the product strategy and operations team to define product strategies and features that align with our goals. Your responsibilities will include constructing knowledge graphs that encompass product understanding, content feedback, and category/brand construction. You will explore the implementation of Knowledge Graphs and Cognitive Graphs to enhance the e-commerce shopping experience on TikTok. Additionally, you will be responsible for mining knowledge related to e-commerce shopping guides, optimizing computer vision models for various tasks such as fine-grain classification, product recognition, and logo detection, and improving the overall shopping experience through e-commerce short videos and live streams. You will also work on e-commerce image search and duplication algorithms, while staying at the forefront of computer vision technology to iterate and evolve our algorithms and systems.

Responsibilities

• Participate in the development of massive knowledge graphs of real-world products to support feed ranking, recommendations, and ads.
• Collaborate with product managers, data scientists, and the product strategy & operation team to define product strategies and features.
• Construct knowledge graphs, including product/content/feedback understanding and category/brand/SPU construction.
• Explore the implementation of Knowledge Graph and Cognitive Graph on the e-commerce side of TikTok e-commerce shopping guide.
• Mine e-commerce shopping guide knowledge such as shopping scenes/people/goods matching/product layering.
• Optimize and iterate computer vision related models in the e-commerce scene, including fine grain classification, product object recognition, product subject recognition, feature extraction, logo detection, brand recognition, etc.
• Classify e-commerce short videos and livestreams, and optimize the shopping experience through multi-modal content mining and understanding.
• Develop algorithms for e-commerce image search and photo search goods, including goods duplication algorithms.
• Explore cutting-edge technology in computer vision and iterate on the overall algorithm and system.

Requirements

• In-depth knowledge in multimedia and computer vision, including image search, image/video classification and recognition, image segmentation, object detection, OCR, graph neural networks, multimodal, unsupervised and self-supervised learning.
• Familiarity with training and deployment of one or more framework models such as TensorFlow, PyTorch, or MXNet, and understanding of training acceleration methods like hybrid precision training and distributed training.

Benefits

• 100% premium coverage for employee medical insurance
• Approximately 75% premium coverage for dependents
• Health Savings Account (HSA) with company match
• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans
• Flexible Spending Account (FSA) options for Health Care, Limited Purpose, and Dependent Care
• 10 paid holidays per year
• 17 days of Paid Personal Time Off (PPTO)
• 10 paid sick days per year
• 12 weeks of paid Parental leave
• 8 weeks of paid Supplemental Disability
• Mental and emotional health benefits through EAP and Lyra
• 401K company match
• Gym and cellphone service reimbursements