New: upload your resume and get matched to AI jobs. Free to start →

Senior Applied AI Engineer

India, Telangana, Hyderabad • Full-time

Posted 1mo ago

Job Location

India, Telangana, Hyderabad

Also open in United States, Washington, Redmond; United States, Georgia, Atlanta

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Agent Engineer

About the job

Join Engineering Operations (EngOps) to drive operational excellence across the Microsoft Cloud. Our mission is to prevent issues before they happen by turning operational signals into action through AI-powered automation, enabling measurable customer impact at cloud scale. We are seeking a hands-on engineer with a DevOps background and AI engineering skills to build and ship production AI solutions that reduce operational demand and improve customer outcomes. You will contribute to the technical execution that turns unresolved cases into autonomously resolved, customer-delighting outcomes, and help build the release, observability, and reliability practices that let a fleet of agents run safely in the customer path. This role involves building and improving agentic patterns that reduce operational demand and improve customer satisfaction, owning the delivery, quality, and production health of the components you build.

Responsibilities

  • Build agentic resolution capabilities for autonomous AI systems.
  • Improve agentic patterns to increase autonomous resolution rate, accuracy, and customer satisfaction.
  • Deliver end-to-end features for autonomous AI systems, including orchestration, reasoning, retrieval, action execution, and human escalation workflows.
  • Shape the technical foundation for agent development by implementing architectures, design patterns, evaluation frameworks, and reusable platform capabilities.
  • Apply and improve standards for prompts, tool interfaces, testing, versioning, code quality, CI/CD, and safe deployment practices.
  • Build evaluation systems to assess agent trustworthiness and validate agentic actions.
  • Support the availability, latency, cost per resolution, SLOs, and error budgets for a fleet of agents.
  • Build observability to explain agent actions and drive durable fixes.
  • Contribute to the evaluation framework for agent safety and effectiveness.
  • Build and maintain golden datasets, rubrics, judge agents, frozen anchors, and offline/online evaluation pipelines.

Requirements

  • Hands-on software engineering experience with a DevOps background (CI/CD, release engineering, safe deployment, observability, production operations).
  • AI engineering skills.
  • Experience building and shipping production-scale AI systems.
  • Experience with CI/CD, safe-deployment, and reliability practices.
  • Familiarity with agentic patterns, orchestration, reasoning, retrieval, and action execution.
  • Understanding of evaluation frameworks and practices for AI systems.
  • Experience with DevOps/SRE operating models.
  • Familiarity with incident response and on-call rotations.
  • Ability to build observability for AI systems.
  • Experience with building and maintaining evaluation systems, including datasets and pipelines.