Lead Data Engineer

$163,500 - $219,200/Yr

Hulu - New York, NY

Full-time - Mid Level

New York, NY

Motion Picture and Sound Recording Industries

About the position

The Lead Data Engineer at Disney Entertainment & ESPN Technology is responsible for developing and enhancing the infrastructure that supports machine learning (ML) applications across various domains. This role focuses on building and improving feature store tooling and services, enabling event-driven ML pipelines, and collaborating with cross-functional teams to drive innovation in data and ML infrastructure. The position plays a crucial role in maximizing the business impact of ML initiatives, particularly in areas such as personalization, fraud prevention, and subscriber growth.

Responsibilities

• Develop and improve feature store tooling and services, contributing to ML infrastructure development.
• Collaborate with ML practitioners to build a streaming data ecosystem.
• Develop low-latency services to enable and support event-driven pipelines.
• Work on multi-faceted projects with engineers from diverse backgrounds and skills across teams.
• Drive and maintain a culture of quality, innovation, and experimentation.
• Work in an Agile environment that focuses on collaboration and teamwork.

Requirements

• Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or a comparable field of study, and/or equivalent work experience.
• 7+ years of software experience working in large scale, real-time distributed systems.
• Experience building and deploying big data pipelines in production.
• Experience with cloud technologies in AWS or GCP, as well as container systems such as Docker or Kubernetes.
• Passion for building platforms and infrastructure excellence.
• Excellent communication and people engagement skills.

Nice-to-haves

• Familiarity with ML pipelines, data ecosystem, and AWS technologies.
• Experience building ML infrastructure and streaming ML applications.
• Experience shipping entertainment and media applications for streaming purposes.

Benefits

• Medical benefits
• Financial benefits
• Bonus and/or long-term incentive units may be provided as part of the compensation package.