Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)
$230k - $262k • New York, NY • Full-time
Posted 23d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
Capital One is seeking a Sr. Manager, AI Engineer to join the Intelligent Foundations and Experiences (IFX) team. This role will focus on building responsible and reliable AI systems that are transforming the banking industry. You will partner with cross-functional teams to deliver AI-powered products, oversee the design and development of AI software components, and make critical build-vs-buy decisions for AI technologies. The position involves inventing and introducing state-of-the-art foundation model optimization techniques to enhance the performance of large-scale production AI systems, contributing to the technical vision and roadmap for foundational AI systems, and operationalizing Responsible AI practices. You will also be responsible for attracting and retaining top AI talent and fostering a culture of continuous learning and professional development.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Oversee the design, development, testing, deployment, and support of AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, and governance.
- Make build-vs-buy decisions for Open Source and SaaS AI technologies.
- Invent and introduce state-of-the-art foundation model optimization techniques to improve performance, scalability, cost, latency, and throughput of AI systems.
- Contribute to the technical vision and long-term roadmap of foundational AI systems.
- Attract and retain top AI talent and nurture team development.
- Translate enterprise AI goals into actionable team roadmaps with measurable outcomes.
- Operationalize Responsible AI by establishing review gates, documentation, evaluation requirements, and rollout/rollback standards.
- Create strong collaboration interfaces with Research, Data, and Platform teams to accelerate the model lifecycle.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 4 years of experience.
- At least 1 year of people leadership experience.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience in building agentic AI systems and agentic workflows.
- Passion for staying abreast of the latest AI research and systems, and applying novel techniques in production.
- Excellent communication and presentation skills, with the ability to articulate complex AI concepts.
- Experience leading technical strategy for a multi-disciplinary AI team.
- Familiarity with MLOps and AI observability (evaluation pipelines, drift monitoring, model/version governance).
- Track record mentoring engineers/scientists to productize prototypes.