About the position
At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems—from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks. AI Data Quality enables comprehensive visibility into data, ML, and LLM pipelines - from data and features to ML models. As data volumes increase, managing complex data pipelines becomes resource-intensive, resulting in significant time and effort to maintain and troubleshoot; requiring additional tools and added complexity. The AI Data Quality team is dedicated to ensuring high data quality and reliability through automated profiling and anomaly detection at scale, which helps enterprises proactively address potential issues before they impact downstream processes. Powered by Unity Catalog Mosaic AI, we empower our users to ensure that their data and AI assets are high quality, accurate and reliable through deep insight into the lineage of their data and AI assets.
Responsibilities
- Innovate and optimize to ensure the highest quality and performance.
- Leading a talented engineering team to build both the product and infrastructure for AI Quality PlatformFeature Engineering Platform, driving the adoption and revenue of the platform.
- Overseeing sustained recruitment of top-tier talent, fostering a well-organized and synergistic team structure, and collaborating effectively with internal and external stakeholders.
- Drive strategy and vision for data quality initiatives across Databricks.
- Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities.
Requirements
- 5+ years of Distributed experience
- Experience building highly-available cloud services
- Experience working cross functionally across departments (PM, Sales, CS)
- Experience building, growing, and managing high performance teams.
- Experience scaling engineering teams from 5 to 30+
- Experience in defining and meeting SLOs for highly-available systems
- Ability to attract and hire engineers who meet the Databricks hiring standards
- Knowledge of Data Monitoring Platforms and AI platforms (highly Preferred)
- BS in Computer Science (Masters or PhD Preferred)
