Senior Data Engineer, TikTok Multimedia
Tiktok - San Jose, CA
posted 5 months ago
About the position
TikTok is the leading destination for short-form mobile video, with a mission to inspire creativity and bring joy to over 1 billion users globally. The Multimedia Data Platform team plays a crucial role in optimizing the app experience for TikTok users by providing essential data support. This team collaborates with various departments within TikTok to enhance the creation and consumption of video content, focusing on comprehensive optimization solutions that span the entire video lifecycle, including client interactions, video shooting, uploading, playback, delivery, and player functionality. As a Senior Data Engineer on the Multimedia Data Platform team, you will be responsible for building state-of-the-art streaming and batch data processing solutions. Your work will directly support TikTok's core business of short video content, as well as horizontal business initiatives across the platform. You will have the opportunity to work with Petabyte-level data warehouses and tackle some of the most challenging technical and business problems in the industry. In this role, you will apply your extensive knowledge of technology options and design techniques to build systems that meet high-quality standards. You will be involved in analyzing systems, defining transformation requirements, and designing suitable data models. Your passion for quality and productivity will drive you to use efficient development techniques and standards. You will also be responsible for maintaining automated tests and managing data profiling runs to ensure that data products and pipelines meet expectations. Collaboration with analysts, engineers, and product managers will be key to applying TikTok Multimedia's analytical methods to meet client needs. Additionally, you will contribute to the growth of the Data Quality Excellence practice by sharing knowledge and improving best practices, all while fostering a positive and supportive workplace culture.
Responsibilities
- Build state-of-the-art streaming and batch data processing solutions.
- Apply broad knowledge of technology options and design techniques across the Data Engineering ecosystem.
- Build systems and datasets using software engineering best practices and data management fundamentals.
- Analyze systems, define transformation requirements, and design suitable data models.
- Drive the design, execution, and maintenance of automated tests and manage data profiling runs.
- Partner with analysts, engineers, and product managers to apply analytical and quality methods.
- Participate in the growth of the Data Quality Excellence practice by sharing knowledge and improving best practices.
- Effectively communicate through technical documentation and interactions with stakeholders.
Requirements
- BS/BA in Technical Field, Computer Science or Mathematics.
- 6+ years experience in the data warehouse space.
- 6+ years experience in custom ETL design, implementation and maintenance.
- 5+ years experience working with big data technologies (Hadoop, Hive, Spark, Clickhouse, etc.).
- 5+ years experience with schema design and dimensional data modeling.
- 6+ years experience in writing SQL statements.
- Proficient in one of Programming languages (e.g., Python, Go, C++).
- Strong communication skills, including the ability to identify and communicate data-driven insights.
- Ability to manage and communicate data warehouse plans to internal clients.
Benefits
- 100% premium coverage for employee medical insurance
- Approximately 75% premium coverage for dependents
- Health Savings Account (HSA) with company match
- Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans
- Flexible Spending Account (FSA) Options
- 10 paid holidays per year
- 17 days of Paid Personal Time Off (PPTO)
- 10 paid sick days per year
- 12 weeks of paid Parental leave
- 8 weeks of paid Supplemental Disability
- Mental and emotional health benefits through EAP and Lyra
- 401K company match
- Gym and cellphone service reimbursements
