Senior Software Engineer - CoreAI (Foundry Observability)
$120k - $235k • United States, Washington, Redmond • Full-time
Posted 1mo ago
Job Location
United States, Washington, Redmond
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
The Microsoft Foundry Observability team within CoreAI is building observability, evaluation, and optimization tools for AI capabilities, including model inferencing, AI services, model customization, and agentic solutions. As a Senior Software Engineer, you will develop and enhance large-scale, cloud-native systems that manage the entire lifecycle of advanced agentic applications. This includes secure enterprise deployment, governed tool integration, fine-tuning and training workflows, and production observability, evaluation, and optimization. Your contributions will be crucial in enabling developers and enterprises to build reliable, autonomous, and high-impact AI agents.
Responsibilities
- Lead the design, development, and delivery of large-scale AI services and platforms focusing on scalability, reliability, security, and performance.
- Design and implement distributed systems and cloud services for reliable enterprise-scale agent execution.
- Drive innovation in observability, automation, deployment safety, and operational efficiency using reusable platforms and frameworks.
- Enhance developer and researcher workflows with improved tooling, abstractions, and automation for fine-tuning, evaluation, and optimization.
- Debug and optimize interactions between models, data, and infrastructure.
- Contribute to technical design and implementation throughout the software development lifecycle.
- Maintain high standards for code quality, testing, reliability, and operational excellence.
- Collaborate with partner teams across CoreAI and Azure to deliver production-ready platform capabilities.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
- Demonstrated proficiency in leveraging AI to build systems and a passion for making AI accessible.
- 3+ years of technical engineering experience with machine learning or AI systems.
- 5+ years of technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems.
Benefits
- Base pay range for IC4: USD $119,800 - $234,700 annually (US); USD $160,200 - $261,000 (SF Bay Area/NYC)
- Base pay range for IC5: USD $142,800 - $274,800 annually (US); USD $188,000 - $304,200 (SF Bay Area/NYC)
- Eligibility for other benefits and compensation.
