Principal Applied AI Engineer
India, Telangana, Hyderabad • Full-time
Posted 1mo ago
About the job
The Engineering Operations (EngOps) team is seeking a Principal Applied AI Engineer to transform Azure customer support through AI-first systems. This role involves acting as a hands-on technical architect and developer for production agentic AI services. You will define and implement the architecture for next-generation AI agents, focusing on LLM orchestration, multi-agent coordination, retrieval-augmented generation (RAG), tool integration, and evaluation systems. This is a deeply technical individual contributor role with broad architectural scope, responsible for turning ambiguous problems into scalable systems, making critical design decisions, building foundational components, and shipping secure and reliable AI services that handle thousands of customer cases monthly.
Responsibilities
- Architect and build production agentic AI systems, including LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, and human-in-the-loop experiences.
- Write, review, and maintain production-quality C# and Python code, building critical components and reusable platform capabilities.
- Translate customer support scenarios into technical requirements and manage solutions from architecture through deployment and continuous improvement.
- Define architecture patterns, API contracts, code quality expectations, evaluation practices, and observability standards for AI services.
- Design and implement evaluation frameworks using rubrics, datasets, simulation, and judge models for AI development.
- Ensure AI services meet high standards for correctness, availability, latency, scalability, cost, and safety, and lead incident response.
- Embed responsible AI principles, privacy protections, and security measures into system architecture and implementation.
- Evaluate models, frameworks, platforms, and architectural approaches based on experimental evidence and production telemetry.
- Partner with product managers and other teams to shape technical strategy and platform capabilities.
- Instrument systems and use data to improve automation accuracy, reduce case volume, and enhance customer satisfaction.
- Lead architecture reviews, resolve technical disagreements, and align engineers and partner organizations.
- Mentor engineers in system design, software engineering, applied AI, and evaluation-driven development.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
- 12+ years of professional software engineering experience designing, building, and operating production software systems.
- Proficiency in C# and/or Python, with demonstrated ability to design and implement complex systems.
