Freewheel

posted about 2 months ago

Full-time - Mid Level
Repair and Maintenance

About the position

As a Senior Data Engineer in the Ad Tech division at Comcast, you will be part of a dynamic team that is responsible for powering identity and audience functionality within FreeWheel products. This role involves working with large-scale data processing, where you will be ingesting over 10TB of data daily and managing datasets that contain more than a trillion records. Your primary focus will be on designing and building data processing pipelines using cutting-edge technologies, including AWS services and various open-source tools. You will collaborate closely with project stakeholders to identify product and technical requirements, ensuring that the solutions you develop meet the needs of both internal and external clients. In this position, you will continually acquire new data sources to enrich the datasets that characterize audiences, and you will work alongside serving teams and report teams to translate complex product requirements into high-quality, cloud-native data solutions. Your role will also involve improving the codebase and participating in agile ceremonies, ensuring that the team adheres to best practices in software development. You will be expected to present and defend architectural and design choices, oversee documentation of development activities, and provide guidance to other engineers on the team. This is an exciting opportunity for someone who is passionate about data engineering and wants to work with a tightly-knit team to solve challenging problems using state-of-the-art data collection, transformation, analysis, and monitoring tools in the cloud. If you are results-driven, adaptable, and possess a strong problem-solving mindset, this role could be a perfect fit for you.

Responsibilities

  • Collaborates with project stakeholders to identify product and technical requirements.
  • Conducts analysis to determine integration needs.
  • Designs and builds data processing pipelines using cutting-edge AWS services and open-source/commercial software.
  • Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
  • Collaborates with serving and report teams to translate complex product requirements into high-quality cloud-native data solutions.
  • Works with Lead Engineers and Architects to contribute to the broader technical vision.
  • Implements improvements to the codebase and participates in agile ceremonies.
  • Presents and defends architectural, design, and technical choices to internal audiences.
  • Oversees the documentation of all development activities.
  • Provides guidance and support to other Engineers.

Requirements

  • Ad Tech or Streaming experience
  • Flink experience
  • Preferably Scala experience but open to Java
  • 5+ years of hands-on work in software development
  • 3+ years of experience with data applications (Spark, Presto, Hive, etc.)
  • 3+ years of experience in designing and building ETL pipelines to process data at scale
  • 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc.)
  • 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
  • Excellent coding skills with Scala/Java, Python
  • Must be versatile and an inquisitive problem solver
  • Excellent communication and writing skills
  • Bachelor's or master's degree in Computer Science or similar field of study

Benefits

  • Paid Time off
  • Physical Wellbeing support programs
  • Financial Wellbeing benefits
  • Emotional Wellbeing support
  • Life Events + Family Support benefits
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service