Large Language Model Architect

Coimbatore

Posted 2d ago

About the job

We are seeking a Large Language Model Architect to design and build enterprise-grade LLM, GenAI, and agentic AI components for client engagements. This hands-on engineering role involves translating high-level architecture into production-quality code, focusing on LLM-driven applications, RAG pipelines, and multi-agent workflows. You will leverage practical industry experience to identify domain data, process constraints, and risks, ensuring GenAI solutions are safe, scalable, and relevant. As a technical lead, you will contribute code, design decisions, reusable patterns, and documentation.

Responsibilities

  • Design and build LLM application components including prompts, tools, agents, orchestration flows, memory/context handling, retrieval pipelines, and evaluation harnesses.
  • Build data-grounded agentic applications on the lakehouse, implementing RAG with Delta tables, Vector Search, and governed features.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for enterprise content.
  • Engineer safety and control components such as PII detection/redaction, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with stakeholders to convert solution designs into tested, observable, and maintainable software components.
  • Maintain technical artifacts including component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
  • Minimum 5 years of experience required.
  • Hands-on coding experience in Python.
  • Strong understanding of APIs, distributed systems, CI/CD, testing, observability, and secure SDLC practices.
  • Experience delivering AI/ML or data products in at least one industry domain (financial services, healthcare, manufacturing, retail, telecom, or life sciences).
  • Hands-on experience with Databricks Mosaic AI, Model Serving, Agent Framework, MLflow tracing/evaluation, Vector Search, Unity Catalog, Delta Lake, Lakehouse Monitoring, Feature Store, Databricks Workflows, Jobs, and notebooks.
  • Strong understanding of LLM application architecture patterns including RAG, function/tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics.
  • Ability to implement traditional ML and GenAI components across ingestion, feature/data preparation, model integration, deployment, monitoring, and continuous improvement.
  • Practical knowledge of security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments.
  • 15 years of full-time education.

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.