Senior Data Scientist - M365 Copilot, Agents & Platform - Turing Team
$120k - $235k • United States, Washington, Redmond; United States, California, Mountain View • Full-time
Posted 29d ago
About the job
Join the Microsoft Turing team and help shape the future of enterprise and consumer productivity with M365 Copilot. You will be part of a fast-paced, high-visibility team delivering innovative platform capabilities and solutions across Microsoft to hundreds of millions of users. As a Senior Data Scientist, you will transform how organizations use data by preparing and analyzing large-scale datasets, designing evaluations, running experiments, and driving evidence-based decisions with measurable business impact. You will own the analytical lifecycle from data discovery and study design through measurement, insight generation, and product recommendations, working in multidisciplinary teams alongside engineers, product managers, and applied scientists. Our work is powered by AI, applying data, experimentation, and evaluation across the development lifecycle while maintaining the highest standards of security, quality, and trust. The Microsoft Turing team advances large language models and pioneers conversational search experiences, building core platform capabilities behind Microsoft 365 Copilot and bringing AI-powered experiences into production at enterprise scale.
Responsibilities
- Prepare and analyze large-scale datasets, including customer feedback, text, and multimodal logs, using Python, SQL, KQL, or similar languages.
- Build representative evaluation datasets for enterprise and consumer scenarios, covering information retrieval, text creation, image and file workflows, and various domains like shopping, education, coding, and finance.
- Design evaluation coverage for text and voice inputs, single- and multi-turn conversations, and location-sensitive prompts.
- Partner with engineering, product management, and applied science teams to define measurement strategies and inform product decisions.
- Share findings, limitations, and recommendations to improve Microsoft 365 Copilot experiences.
- Own experiment design and impact measurement for optimization hypotheses, including success metrics, guardrails, and result interpretation.
- Contribute to response-quality side-by-side evaluations by designing studies and rubrics, analyzing results, and assessing statistical and practical significance.
- Compare LLM-based and human evaluations, validate alignment, investigate biases, and refine studies.
- Develop decision-relevant metrics, dashboards, and narratives to translate analyses into actionable product recommendations.
- Present findings and analytical limitations to technical and executive audiences.
- Stay current with AI offerings and competitive developments to identify feature gaps and opportunities.
- Provide mentorship through analytical code reviews, study-design guidance, and sharing data science best practices.
Requirements
- Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience.
- OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience.
- OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience.
- OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
