SENIOR DATA ENGINEER

Yeah! Global - San Francisco, CA

Full-time - Senior

San Francisco, CA

About the position

The Senior Data Engineer will play a crucial role in enhancing the data models and infrastructure necessary for effective data management and analytics. This position involves collaboration with various teams to ensure the integrity and accessibility of data, particularly in the context of machine learning and real-time monitoring. The role is hybrid, based in San Francisco, and offers the opportunity to work on significant data initiatives that impact the company's product offerings.

Responsibilities

• Devise, construct, and take charge of the core data models and infrastructure to govern data throughout the analytics stack, including AWS, Kafka, Glue, S3, Snowflake, Cassandra, Cockroach DB, Tableau, and Datadog.
• Forge partnerships with Data Analysts to provide essential data for dashboards, ad-hoc analyses, and decision-making.
• Collaborate with ML Engineering and Data Science teams to enhance data pipelines for machine learning, analytics, and data annotation.
• Formulate and execute a data quality monitoring system with source-to-target data validations and anomaly detection.
• Partner with Security and Engineering teams to meet data governance requirements.

Requirements

• Mastery of SQL.
• Substantial proficiency in Python or equivalent programming language.
• Over five years of hands-on experience with analytical data warehouses/lakes.
• Preference for expertise in AWS/Snowflake.
• Over five years of experience in developing data pipelines supporting ML/NLP initiatives.
• Familiarity with leading MLOps and data annotation platforms is advantageous.
• Over five years of experience analyzing complex datasets using SQL and collaborating with Data Analysts to automate dashboards (especially with Tableau).
• Bachelor's degree in Computer Science or a related field; possession of an MS/PhD is a bonus.
• Familiarity with source code repositories and cloud monitoring tools (preferably Datadog).
• Exceptional communication skills and robust analytical abilities.

Nice-to-haves

• Familiarity with leading MLOps and data annotation platforms.
• Possession of an MS/PhD in a relevant field.