AI Infrastructure Architect
Remote • Coimbatore
Posted 2d ago
Job Location
Coimbatore
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
Accenture is seeking an AI Infrastructure Architect to design and build custom AI infrastructure and hardware solutions. This role focuses on optimizing the performance, power consumption, cost, and scalability of the computational stack. You will advise on AI infrastructure technology, vendor evaluation, selection, and full-stack integration. The position involves hands-on engineering for enterprise-grade LLM, GenAI, and agentic AI components, with a focus on Azure platform engineering. You will translate high-level architecture into production-quality components for LLM-driven applications, RAG pipelines, multi-agent workflows, and AI platform integrations, bringing practical industry experience to ensure solutions are safe, scalable, and relevant. As a technical or engineering lead, you will contribute code, design decisions, reusable patterns, and documentation.
Responsibilities
- Design and build LLM application components including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
- Create Foundry-based agents with enterprise tools, knowledge, and memory.
- Integrate Azure AI Search for RAG.
- Implement secure API/tool calls through API Management, Logic Apps, and Functions.
- Instrument traces, evaluations, guardrails, and policy controls for production agents.
- Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for enterprise content.
- Engineer safety and control components including PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
- Collaborate with stakeholders to convert solution designs into tested, observable, and maintainable software components.
- Maintain technical artifacts such as component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.
Requirements
- Bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
- Hands-on coding experience in Python.
- Strong understanding of APIs, distributed systems, CI/CD, testing, observability, and secure SDLC practices.
- Experience delivering AI/ML or data products in at least one industry domain (banking, insurance, healthcare, public sector, retail, or energy).
- Hands-on experience with Microsoft Foundry / Azure AI Foundry, Foundry Agent Service, Azure OpenAI models, Azure AI Search, Prompt Flow, Azure Functions, Logic Apps, API Management, Event Grid, Microsoft Fabric, Entra ID, Key Vault, Azure Monitor, and Application Insights.
- Strong understanding of LLM application architecture patterns including RAG, function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics.
- Ability to implement traditional ML and GenAI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement.
- Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems.
- Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments.
- Minimum 7.5 years of experience.
- 15 years full-time education.