Lead Data Engineer, Data Reliability

$149,300 - $200,200/Yr

Disney - Seattle, WA

Full-time - Mid Level

Seattle, WA

Motion Picture and Sound Recording Industries

About the position

The Lead Data Engineer at Disney Entertainment & ESPN Technology plays a crucial role in enhancing the reliability of Disney's big data platform, which processes vast amounts of data daily. This position involves collaborating with various teams to improve data pipeline performance and observability, ensuring that Disney remains data-driven in its decision-making processes. The role is high-impact, directly influencing the company's revenue and consumer experiences through innovative data solutions.

Responsibilities

• Assist in designing and developing a platform to support incident observability and automation.
• Build high-quality data models and products that monitor and report on data pipeline health and data quality.
• Lead project work efforts internally and externally, setting project deliverables, reviewing design documents, performing code reviews, and mentoring junior team members.
• Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on big data pipeline infrastructure.
• Own the development of key components for observability and intelligent monitoring of data pipelines and infrastructure for early anomaly detection and alerting.
• Present research and insights to all levels of the company clearly and concisely.
• Build solutions to improve software release and change management processes using industry best practices.

Requirements

• 7+ years of experience working on mission-critical data pipelines and ETL systems.
• 7+ years of hands-on experience with big data technology, systems, and tools such as AWS, Hadoop, Hive, and Snowflake.
• Detailed problem-solving approach with a strong sense of ownership and drive.
• A passionate bias to action and a commitment to delivering high-quality data solutions.
• Expertise in common Data Engineering languages such as Python, Scala, Java, SQL, and a proven ability to learn new programming languages.
• Experience with workflow orchestration tools such as Airflow.
• Deep understanding of end-to-end pipeline design and implementation.
• Attention to detail and quality with excellent problem-solving and interpersonal skills.

Nice-to-haves

• Advanced degrees are a plus.
• Strong data visualization skills to convey information and results clearly.
• Ability to work independently and drive your own projects.
• Exceptional interpersonal and communication skills.
• Impactful presentation skills in front of a large and diverse audience.
• Experience with DevOps tools such as Docker, Kubernetes, Jenkins, etc.
• Innate curiosity about consumer behavior and technology.
• Experience with event messaging frameworks like Apache Kafka.
• A fan of movies and television is a strong plus.

Benefits

• Medical insurance coverage
• Financial benefits including bonuses and long-term incentive units
• Support for work-life balance
• Opportunities for professional development