Director, AI Engineering (Remote - eligible)
$245k - $279k • McLean, VA • Full-time
Posted 22d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
LLM Engineer
About the job
Capital One is at the forefront of leveraging AI to create responsible and reliable AI systems that are transforming banking. The Intelligent Foundations and Experiences (IFX) team is central to this vision, building and deploying proprietary AI solutions that deliver value to millions of customers. This role will partner with cross-functional teams to deliver AI-powered products, oversee the design and development of AI software components, and make critical build-vs-buy decisions across a broad stack of AI technologies. You will invent and introduce state-of-the-art foundation model optimization techniques, contribute to the technical vision and roadmap of foundational AI systems, and attract and retain top talent in the AI industry. The role also involves scaling AI engineering practices, establishing enterprise standards for Responsible AI, and partnering with research and risk teams to ensure ethical and regulatory compliance.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Oversee the design, development, testing, deployment, and support of AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Make build-vs-buy decisions across Open Source and SaaS AI technologies.
- Invent and introduce state-of-the-art foundation model optimization techniques to improve performance of large-scale production AI systems.
- Contribute to the technical vision and long-term roadmap of foundational AI systems.
- Attract and retain top AI talent and foster team development.
- Translate enterprise AI strategy into execution plans across multiple product areas.
- Scale AI engineering practices through shared infrastructure, reusable components, and unified observability and governance frameworks.
- Establish enterprise standards for Responsible AI, including fairness metrics, model evaluation protocols, documentation, and audit readiness.
- Partner with research, compliance, and enterprise risk teams to ensure deployed systems meet ethical and regulatory standards.
Requirements
- Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
- At least 3 years of people leadership experience.
- 5+ years of experience managing and leading an engineering team.
- 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience in building agentic AI systems and agentic workflows.
- Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production.
- Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.
- Experience building and leading multi-team AI organizations delivering multiple enterprise products or capabilities concurrently.
- Proven ability to expand and execute long-term strategies.