AI Engineer 4 (Vision model (VLM) customization experience)
$197k - $225k • New York, NY • Full-time
Posted 1mo ago
About the job
Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance customer interactions and internal operations. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, AI agents, similarity search, and model evaluation. The position requires inventing and implementing state-of-the-art foundation model optimization techniques to improve the performance of large-scale production AI systems, contributing to the technical vision and roadmap for foundational AI systems, and owning the end-to-end architecture for complex AI systems. You will also define and maintain service-level objectives for AI reliability, collaborate with infrastructure engineering to optimize GPU/TPU utilization, and lead technical reviews for new AI system deployments.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components.
- Leverage Open Source and SaaS AI technologies.
- Invent and introduce state-of-the-art foundation model optimization techniques.
- Contribute to the technical vision and roadmap of foundational AI systems.
- Own the end-to-end architecture for complex AI systems.
- Define and maintain service-level objectives for AI reliability.
- Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
- Lead cross-functional technical reviews for new AI system deployments.
- Mentor associates on scalable design, performance tuning, and research-to-production translation.
Requirements
- Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 2 years of experience.
- At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
- Experience leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
- 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure).
- Experience designing, developing, delivering, and supporting AI services.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software.
- Experience in building agentic AI systems and agentic workflows.
- Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale.
- Experience defining AI model governance processes.
- Demonstrated ability to influence architectural decisions across multiple AI product lines.