Principal Associate, AI Engineer
$148k - $169k • Toronto, ON • Full-time
Posted 18d ago
About the job
Capital One Canada is seeking a Principal Associate, AI Engineer to join their Intelligent Foundations and Experiences (IFX) team. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance associate workflows and customer interactions. You will be responsible for designing, developing, testing, deploying, and supporting AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, and governance. The position leverages a variety of Open Source and SaaS AI technologies and focuses on inventing and implementing state-of-the-art LLM optimization techniques to improve the performance of large-scale production AI systems. You will also contribute to the technical vision and long-term roadmap for foundational AI systems within the company.
Responsibilities
- Partner with cross-functional teams (engineers, research scientists, TPMs, product managers) to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Leverage Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
- Invent and introduce state-of-the-art LLM optimization techniques to improve performance (scalability, cost, latency, throughput) of large-scale production AI systems.
- Contribute to the technical vision and long-term roadmap of foundational AI systems.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies, OR Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 1 year of experience.
- At least 3 years of experience programming with Python, Go, Scala, or Java.
- Experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience developing, delivering, and supporting AI services.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
Benefits
- Access to tools and mentorship for upskilling, pivoting into new business areas, or mastering craft.
- Holistic suite of benefits designed to support your whole self.