Engineering Manager - Streaming

$192,000 - $260,000/Yr

Databricks - Mountain View, CA

Full-time - Manager

Mountain View, CA

5,001-10,000 employees

Professional, Scientific, and Technical Services

About the position

The Engineering Manager for Streaming at Databricks will lead the Structured Streaming team, focusing on developing and enhancing the Spark Structured Streaming engine. This role involves overseeing the engineering team, managing technical architecture, and ensuring high-quality software development while promoting Stream Processing capabilities within the Databricks Data Intelligence Platform. The manager will also be responsible for recruitment, team development, and aligning product vision with organizational goals.

Responsibilities

• Lead a talented engineering team in Structured Streaming development.
• Oversee recruitment of top-tier talent and upskill team members.
• Build processes to implement product vision and strategy according to organizational goals.
• Develop high-quality, easy-to-operate software.
• Guide Stream Processing adoption across the Databricks product portfolio.
• Manage technical debt and long-term technical architecture decisions.

Requirements

• 5+ years of experience in a related system, including big-data ecosystem, Apache Spark™, or database internals.
• Passion for database systems, storage systems, distributed systems, language design, or performance optimization.
• Ability to ensure the team builds high-quality and reliable infrastructure services.
• Experience in testing, quality assurance, and managing Service Level Agreements.
• Experience building and managing teams in complex technical domains.
• Expertise in attracting, hiring, and coaching engineers.
• Experience managing distributed teams.
• Ability to work with product management and understand customer needs.

Benefits

• Comprehensive benefits and perks tailored to employee needs.
• Eligibility for annual performance bonus and equity.