Principal AI/ML Architect
Salary not listed • Hyderabad • Full-time
Posted 8d ago
Job Location
Hyderabad
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Engineer
About the job
Egen is seeking a Principal AI/ML Architect to set the technical direction for complex generative AI, agentic AI, and applied machine learning projects. This role requires a hands-on approach to architecting production-ready systems and mentoring engineers. You will tackle challenging architectural problems, including large-scale agentic platforms, advanced retrieval systems, and AI in high-stakes environments. Responsibilities include translating business strategy into AI architecture, shaping solutions during pre-sales, and guiding engineering teams to build robust, scalable, and secure AI services. The ideal candidate will have deep expertise in AI software engineering principles and a commitment to continuous learning and innovation.
Responsibilities
- Set enterprise AI architecture and technical direction, defining reference architectures, patterns, and technology choices.
- Build and architect foundation-model and embedding fine-tuning, advanced RAG, semantic search, and agentic workflows.
- Engineer AI systems for production, focusing on latency, reliability, security, cost, scalability, and maintainability.
- Architect agentic systems at scale, including multi-step reasoning and multi-agent workflows with robust orchestration and controls.
- Establish evaluation, observability, and responsible AI standards for AI systems.
- Shape data and retrieval architectures for production-scale knowledge systems.
- Advise clients and shape opportunities by translating business strategy into AI roadmaps and solution architectures.
- Multiply engineering capability through architecture reviews, code reviews, and mentoring.
- Guide initiatives from problem framing and experimentation through production rollout and measurable business value.
Requirements
- Expert-level Python and strong shell scripting skills.
- Experience with API and service design, distributed systems, and full SDLC ownership.
- Deep, current expertise with Google Gemini, GPT-class models, LLaMA, and other open models.
- Advanced prompt engineering, structured outputs, model selection, fine-tuning, and rigorous evaluation experience.
- Hands-on production experience with Google Agent Development Kit (ADK), LangChain, custom agent frameworks, tool use, MCP, workflow orchestration, planning, memory, state, guardrails, human-in-the-loop controls, and multi-agent design.
- Advanced RAG, hybrid and semantic search, embeddings, re-ranking, and vector platforms experience.
- End-to-end experience architecting highly available, scalable AI and software environments across Google Cloud / Vertex AI, AWS, and Azure.
- Strong command of LangChain, LlamaIndex, or equivalent orchestration layers.
- Experience with MLOps and LLMOps practices, including CI/CD, model/prompt versioning, experiment tracking, automated evaluation, observability, and monitoring.
- Strong SQL and data engineering skills, and classical machine learning knowledge.