Applied AI Engineer II
India, Telangana, Hyderabad • Full-time
Posted 1mo ago
Job Location
India, Telangana, Hyderabad
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
ACES CØDE is a Microsoft engineering organization focused on reducing operational demand across the Microsoft Cloud by turning customer and operational signals into lasting product improvements, intelligent diagnostics, autonomous resolution systems, and AI-powered capabilities. We are seeking an Applied AI Engineer to help build the next generation of production agentic AI services that resolve customer issues faster, reduce avoidable support demand, and improve the reliability and scalability of AI-first support experiences. You will take product specifications and turn them into production-ready, scalable AI services, working with LLM orchestration, multi-agent coordination, and RAG-based systems, shipping production services that directly impact Azure customers.
Responsibilities
- Translate product specifications into AI service architectures, decomposing business intent into agent workflows, data source integrations, and scalable service designs.
- Build agentic AI workflows using Azure AI Foundry Agent Service and Microsoft Agent Framework, including multi-agent coordination, tool integrations, and agent lifecycle management.
- Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipeline design.
- Build evaluation systems including rubrics, golden datasets, and judge agents to validate agent correctness and safety before production deployment.
- Write production-quality C# and Python with test-driven development, ensuring services meet reliability, performance, and security standards.
- Deploy services using CI/CD pipelines, feature flags, and staged rollouts with full production observability (tracing, logging, metrics).
- Implement secure service patterns including RBAC, Managed Identities, and secrets management.
- Integrate agents with Azure data sources and cloud-native services to ground agent responses in real-time signals.
- Apply Responsible AI practices across all agent development, ensuring outputs are safe, fair, and compliant.
- Own the end-to-end lifecycle of AI service components, including design, development, testing, deployment, monitoring, and incident response.
Requirements
- Bachelor's degree in Computer Science, Engineering, or related field.
- 3+ years of software engineering experience in C# and/or Python, with production deployment experience.
- Experience building or integrating with LLM-based systems (prompt engineering, RAG, or agent frameworks).
- Familiarity with Azure services (Azure OpenAI, Azure AI Foundry, Azure Functions, Cosmos DB, or similar cloud-native technologies).
- Experience with CI/CD pipelines, automated testing, and production observability.
- Understanding of data structures, algorithms, and system design fundamentals.
- Experience with multi-agent orchestration and agent-to-agent communication protocols.
- Experience with evaluation frameworks for AI systems (rubrics, golden datasets, judge agents).
- Familiarity with RAG pipelines and vector retrieval systems.
- Experience with container orchestration, microservices architecture, and cloud-native deployment patterns.
- Experience with security practices (RBAC, Managed Identities, secrets management).
Benefits
- Opportunity to build AI services that directly impact millions of Azure customers worldwide.
- Work at the cutting edge of agentic AI, LLM orchestration, and multi-agent systems.
- Collaborative and inclusive work culture centered on growth mindset.
- Continuous learning and career development in applied AI engineering.
- Access to cutting-edge Azure AI technologies and global impact projects.
