AI Engineer 3 (AI Foundations)
$162k - $185k • New York, NY • Full-time
Posted 8d ago
Job Location
New York, NY
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Engineer
About the job
Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team, which is central to bringing AI vision to life. This role involves partnering with cross-functional teams to deliver AI-powered products that transform customer interactions and associate workflows. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents, similarity search, guardrails, and model evaluation. The position leverages a broad stack of Open Source and SaaS AI technologies and focuses on inventing and optimizing state-of-the-art foundation models for large-scale production AI systems. You will also contribute to the technical vision and roadmap for foundational AI systems, lead development of agentic workflows, and implement scalable pipelines for model training and deployment.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components.
- Leverage Open Source and SaaS AI technologies.
- Invent and optimize foundation model techniques for performance and scalability.
- Contribute to the technical vision and roadmap of foundational AI systems.
- Lead development and benchmarking of multi-turn conversational and tool-using agent workflows.
- Implement scalable pipelines for training, fine-tuning, and deploying foundation or domain-specific models.
- Collaborate with teams to curate datasets and improve model evaluation methodologies.
- Contribute to governance and security efforts for model traceability and version control.
- Mentor junior AI engineers and advocate for engineering excellence and responsible experimentation.
Requirements
- Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 1 year of experience.
- At least 3 years of experience programming with Python, Go, Scala, CUDA, or Java.
- Experience contributing to AI system components with tradeoff decisions around cost, latency, throughput, and accuracy.
- 4+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure).
- Experience developing, delivering, and supporting AI services.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software.
- Experience in building agentic AI systems and agentic workflows.
- Demonstrated ability to evaluate and optimize LLM performance using quantitative metrics.
- Hands-on experience implementing retrieval-augmented generation (RAG), vector database integrations, and fine-tuning workflows.
