Data Science Manager, Search Quality, Magi AI Overviews

$177,000 - $266,000/Yr

Google - Mountain View, CA

Full-time - Senior

Mountain View, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

The Data Science Manager for Search Quality at Google will lead a team of data scientists focused on evaluating and improving the Google Search user experience. This role involves collaborating with engineers and researchers to analyze data, develop metrics, and integrate new methodologies into existing evaluation systems. The manager will prioritize data science efforts, provide technical leadership, and tackle complex problems related to Generative AI evaluation.

Responsibilities

• Collaborate with stakeholders in cross-projects and team settings to identify and clarify business or product questions to answer.
• Provide feedback to translate and refine business questions into tractable analysis, evaluation metrics, or mathematical models.
• Use custom data infrastructure or existing data models as appropriate, using specialized knowledge.
• Design and evaluate models to mathematically express and solve problems with limited precedent.
• Gather information, business goals, priorities, and organizational context around the questions to answer, as well as the existing and upcoming data infrastructure.
• Own the process of gathering, extracting, and compiling data across sources via relevant tools (SQL, R, Python).
• Ensure quality, and review the dataset to ensure it is ready for analysis.
• Develop analysis methods to improve the quality of Google Search.
• Develop expertise in evaluation and application of Large Language Model and Generative AI.

Requirements

• Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related quantitative field, or equivalent practical experience.
• 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.
• 6 years of experience as a people manager within a technical leadership role.

Nice-to-haves

• 12 years of experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 10 years of experience with a PhD degree.

Benefits

• Base salary range of $177,000-$266,000 + bonus + equity + benefits.