Senior Applied Scientist - AI for Safe Changes Health Gating
$120k - $235k • United States, Washington, Redmond • Full-time
Posted 15d ago
Job Location
United States, Washington, Redmond
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
Machine Learning Engineer
About the job
We are seeking an Applied Scientist to develop machine-learning and AI solutions that improve the safety, reliability, and operational efficiency of Microsoft 365 services, including systems supporting Microsoft 365 Copilot. You will focus on scenario health gating, using service telemetry, change signals, experiments, and operational data to detect regressions, estimate risk, and inform production decisions. You will translate reliability problems into scientific questions, develop and evaluate algorithms, implement production-oriented solutions, and partner with engineers and product managers to deploy and improve them in live environments. The ideal candidate combines strong statistical and machine-learning foundations with practical engineering judgment, comfortable working with noisy data, reasoning with uncertainty, and communicating evidence-based recommendations.
Responsibilities
- Formulate scientific objectives, hypotheses, datasets, baselines, and success metrics for service health and change safety problems.
- Develop and evaluate machine learning, statistical, causal, time-series, or agent-based methods for regression detection, risk estimation, failure attribution, and gating decisions.
- Compare technical alternatives, explaining tradeoffs in accuracy, interpretability, latency, scale, cost, reliability, and customer risk.
- Address noisy, sparse, delayed, imbalanced, and distribution-shifted production data.
- Assess relevant research and adapt promising methods to operational scenarios.
- Build representative evaluation datasets from historical, synthetic, simulated, and production-derived data.
- Design rigorous offline and production evaluations, including baselines, ablation studies, robustness testing, error analysis, and expert or human evaluation.
- Measure precision, recall, false-positive and false-negative rates, calibration, uncertainty, detection latency, and operational cost.
- Create reproducible experimentation and evaluation pipelines.
- Use production telemetry, incident outcomes, and user feedback to improve models and identify failure modes.
- Implement algorithms, data-processing components, and evaluation systems in clean, tested, maintainable code.
- Partner with engineers to integrate scientific components into scalable services and agent workflows.
- Contribute to design decisions involving performance, reliability, diagnosability, monitoring, privacy, security, compliance, and cost.
- Support staged deployment, monitoring, post-launch analysis, and iterative improvement.
- Build reusable tools, libraries, and evaluation methods for additional scenarios.
- Independently drive the applied-science workstream for health-gating scenarios.
- Collaborate with engineers, PMs, data scientists, service owners, and partner scientists.
- Communicate methods, assumptions, limitations, results, uncertainty, and recommendations clearly.
- Influence technical decisions through experimentation and scientific judgment.
- Participate in design, code, model, and experiment reviews.
- Share reusable practices and support peer development through knowledge sharing and mentoring.
- Identify and mitigate risks involving privacy, security, fairness, unsafe automation, data leakage, and inappropriate production actions.
- Design appropriate human oversight, fallback behavior, and safeguards for consequential decisions.
- Track model, system, and business measures such as detection quality, gating effectiveness, robustness, automation coverage, operational-toil reduction, and production adoption.
Requirements
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research).
- OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research).
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research).
- OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.
