Staff AI Engineer role (Remote Eligible)
$245k - $279k • Remote • San Francisco, CA • Full-time
Posted 1mo ago
About the job
Capital One is seeking a Staff AI Engineer to join the Intelligent Foundations and Experiences (IFX) team, which is central to bringing the company's AI vision to life. This role involves partnering with cross-functional teams to deliver AI-powered products that transform how associates work and customers interact with the bank. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, model evaluation, and more. The position offers the opportunity to leverage a broad stack of Open Source and SaaS AI technologies and to invent and introduce state-of-the-art foundation model optimization techniques to improve the performance of large-scale production AI systems. You will also contribute to the technical vision and long-term roadmap of foundational AI systems, set technical direction for enterprise-wide AI architecture, and own the design and integration of model routing, caching, and orchestration systems.
Responsibilities
- Partner with cross-functional teams to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components.
- Leverage Open Source and SaaS AI technologies.
- Invent and introduce state-of-the-art foundation model optimization techniques.
- Contribute to the technical vision and roadmap of foundational AI systems.
- Set the technical direction for enterprise-wide AI architecture.
- Own the design and integration of model routing, caching, and orchestration systems.
- Champion responsible AI principles across all system design.
- Drive internal education, mentorship, and dissemination of best practices.
Requirements
- Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a Master's degree plus at least 6 years of experience.
- At least 8 years of experience programming with Python, Go, Scala, CUDA, or Java.
- Experience designing AI systems with tradeoff decisions around cost, latency, throughput and accuracy.
- 8+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software.
- Experience in building agentic AI systems and agentic workflows.
- Passion for staying abreast of the latest AI research and AI systems.
- Excellent communication and presentation skills.
- Proven track record of defining and operationalizing enterprise AI architecture standards.