Principal Data Scientist

About the position

At Microsoft, our mission is to empower every individual and organization on the planet to achieve more, and we recognize the transformative power of artificial intelligence in realizing this vision. The Bing Metrics and Evaluation team is at the forefront of this journey, meticulously measuring and enhancing the user experience across Bing and Copilot. Our goal is to execute this with precision and efficiency. This role is available in Mountain View, CA, Boulder, CO or Redmond, WA. In this role as a Principal Data Scientist, you will work to improve online metrics that evaluate Product quality in A/B testing and non-A/B testing situations. You will apply sophisticated statistical methods and large language models (LLMs) combined with human labels to conduct thorough evaluations of Bing’s Search Product through the lens of metrics. Your expertise will guide Bing’s product quality assessments, and user satisfaction measurement. As part of the rapidly advancing Search and AI domain, our team is a leader in applied machine learning at Microsoft. We are committed to providing an unparalleled search and AI assistant experience to over 500 million monthly active users globally through Bing. Additionally, our work impacts other major search engines like Yahoo, DuckDuckGo, and emerging platforms such as Neeva and You.com. Join us in shaping the future of search and AI, where your contributions will influence the experiences of users worldwide.

Responsibilities

• Improve online metrics that evaluate Product quality in A/B testing and non-A/B testing situations.
• Apply sophisticated statistical methods and large language models (LLMs) combined with human labels.
• Conduct thorough evaluations of Bing’s Search Product through the lens of metrics.
• Guide Bing’s product quality assessments and user satisfaction measurement.