Senior Applied AI Engineer
India, Telangana, Hyderabad • Full-time
Posted 1mo ago
Job Location
India, Telangana, Hyderabad
Also open in United States, Washington, Redmond; United States, Georgia, Atlanta
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
Join Engineering Operations (EngOps) to drive operational excellence across the Microsoft Cloud. Our mission is to prevent issues before they happen by turning operational signals into action through AI-powered automation, enabling measurable customer impact at cloud scale. We are seeking a hands-on engineer with a DevOps background and AI engineering skills to build and ship production AI solutions that reduce operational demand and improve customer outcomes. You will contribute to the technical execution that turns unresolved cases into autonomously resolved, customer-delighting outcomes, and help build the release, observability, and reliability practices that let a fleet of agents run safely in the customer path. This role involves building and improving agentic patterns that reduce operational demand and improve customer satisfaction, owning the delivery, quality, and production health of the components you build.
Responsibilities
- Build agentic resolution capabilities for autonomous AI systems.
- Improve agentic patterns to increase autonomous resolution rate, accuracy, and customer satisfaction.
- Deliver end-to-end features for autonomous AI systems, including orchestration, reasoning, retrieval, action execution, and human escalation workflows.
- Shape the technical foundation for agent development by implementing architectures, design patterns, evaluation frameworks, and reusable platform capabilities.
- Apply and improve standards for prompts, tool interfaces, testing, versioning, code quality, CI/CD, and safe deployment practices.
- Build evaluation systems to assess agent trustworthiness and validate agentic actions.
- Support the availability, latency, cost per resolution, SLOs, and error budgets for a fleet of agents.
- Build observability to explain agent actions and drive durable fixes.
- Contribute to the evaluation framework for agent safety and effectiveness.
- Build and maintain golden datasets, rubrics, judge agents, frozen anchors, and offline/online evaluation pipelines.
Requirements
- Hands-on software engineering experience with a DevOps background (CI/CD, release engineering, safe deployment, observability, production operations).
- AI engineering skills.
- Experience building and shipping production-scale AI systems.
- Experience with CI/CD, safe-deployment, and reliability practices.
- Familiarity with agentic patterns, orchestration, reasoning, retrieval, and action execution.
- Understanding of evaluation frameworks and practices for AI systems.
- Experience with DevOps/SRE operating models.
- Familiarity with incident response and on-call rotations.
- Ability to build observability for AI systems.
- Experience with building and maintaining evaluation systems, including datasets and pipelines.
