Distinguished AI Engineer
Salary not listed • Bangalore, In • Full-time
Posted 1d ago
About the job
At Capital One, we are building responsible and reliable AI systems to transform banking. We are at the forefront of leveraging AI and machine learning for personalized customer experiences, bringing humanity and simplicity to banking. Our Intelligent Foundations and Experiences (IFX) team is central to this vision, empowering teams across the company with Generative AI models and platforms. We develop powerful, safe, and explainable AI capabilities, including agentic workflows and foundational model power, to enhance products and optimize the software development lifecycle. This role offers the opportunity to reimagine how we serve customers and businesses by bringing the transformative power of emerging AI capabilities to life.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, evals, governance, and observability.
- Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
- Invent and introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) of large-scale production AI systems.
- Devise novel context generation techniques that optimize cost/quality trade-offs.
- Design and implement capabilities for automated monitoring, anomaly detection, and root cause analysis for multi-turn and headless agentic applications.
- Collaborate with business lines to design and implement high-value agentic applications.
- Coach and evangelize, mentoring engineers, authoring technical design documents and blogs, and representing Capital One at AI conferences.
Requirements
- Bachelor's degree in Computer Science, Electrical Engineering or Computer Engineering.
- At least 6 years of experience developing AI and ML algorithms or technologies.
- At least 8 years of experience programming with Python, Go, Scala, or Java.
- 10+ years of experience deploying scalable and responsible solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
- 4+ years of experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- 6+ years of experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- 2+ years of experience with Agentic frameworks (LangChain, CrewAI, AutoGen etc.).
- 2+ years of experience leading GenAI or LLM-Powered application architectures in production.
- 2+ years of experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- 2+ years of experience with Observability and Evals for agentic applications.
- Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production.
- Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
- Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.
- Master’s or Ph.D in Computer Science, Computer Engineering, especially in AI/ML areas.