Senior LLM Engineer Jobs

Scale AI

Scale's LLM post-training platform team builds an internal distributed framework for large language model training, powering MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. This platform also serves as the underlying training framework for the data quality evaluation pipeline. You will work closely with Scale’s ML teams and researchers to build the foundation platform which supports all our ML research and development works, enabling next generation LLM training, inference, and data curation.

$290k - $363k

Scale AI

As a Senior Software Engineer, AI Ops, you will be responsible for the long-term technical health, performance, and stability of AI solutions deployed for strategic public sector partners. You will act as the technical steward, ensuring operational excellence by bridging software engineering, MLOps, and client governance. This includes managing service level agreements (SLAs), tracking model drift, and executing maintenance protocols to protect system integrity and operational margins.

Salary not listed

Lila Sciences is seeking a Senior / Staff Machine Learning Engineer to join their Applied AI organization. This role focuses on adapting and improving AI models for customer-specific scientific needs, bridging the gap between advanced model capabilities and real-world applications. You will be instrumental in transforming frontier AI models into reliable, evaluable workflows for customer contexts. The Applied AI team operates at the nexus of AI research, model engineering, and product deployment, collaborating with researchers and software engineers to integrate and refine Lila's models within product workflows. This position is ideal for individuals who want to specialize in model adaptation and evaluation, take ownership of complex technical challenges, and grow their scope within the company.

$180k - $298k

Toast

Toast is seeking a Staff Software Engineer to lead the technical vision and architecture for its new Intelligence Platform in Dublin. This platform will serve as a governed data layer, bringing restaurant intelligence to various stakeholders including prospects, operators, Toast IQ, and AI agents. The role involves hands-on development, making key design decisions for data processing, privacy, and serving, and mentoring other engineers. The goal is to evolve the platform from initial aggregated data to real-time access for AI agents, ensuring new data products are shipped quickly and safely.

Salary not listed

voize

voize is building AI companions to seamlessly take over digital workflows for frontline workers, amplifying their impact rather than replacing them. With significant Series A funding and a growing user base, the company is seeking a Senior Fullstack Engineer to co-own its in-house ML App. This platform is crucial for annotation, data exploration, ML training orchestration, model evaluation, and managing sensitive data flows, aiming to make external vendor solutions unnecessary.

Salary not listed

As a Developer Platform engineer at Notion, you will contribute to the foundational elements that make Notion extensible and connected. You will build tools, APIs, and platform experiences enabling customers to integrate Notion with their external applications, data, and workflows. Your work will empower developers, admins, and builders to create reliable integrations and automations, making it easier to bring their apps and data into the Notion workspace. You will be a key player in establishing the robust technical foundation for Notion's connected workspace vision, contributing to both internal platform improvements and end-user-facing functionality. This role involves tackling complex technical challenges to ensure the long-term quality, reliability, and performance of Notion's platform as it scales.

$179k - $200k

Ironclad is seeking a Technical Lead Manager to lead a team of engineers focused on building production generative AI systems. This role combines hands-on technical leadership with people management, involving setting the technical direction for the team and fostering engineer growth. The team will own the technical roadmap and quality bar for their systems, partnering with product management to translate business needs into technical deliverables. The Tech Lead Manager will also contribute directly through design documents, architectural decisions, and writing production code for critical problems. A key aspect of the role is staying deeply involved in the team's architecture and technical details to effectively review designs, unblock engineers, and make prioritization calls, while also setting and upholding high engineering standards for code quality, testing, and production monitoring.

$188k - $235k

Deepgram

Deepgram is a leading platform for the Voice AI economy, offering real-time APIs for speech-to-text, text-to-speech, and building voice agents at scale. We empower over 1,300 organizations and 200,000 developers to create voice offerings powered by our advanced foundation models, accessible via cloud APIs or self-hosted solutions. Our AI-first approach means every team member is expected to actively use, experiment with, and build AI tools into their daily work, driving innovation and performance. We operate at the rapid pace of AI, requiring adaptability, continuous learning, and a proactive mindset to solve customer challenges and push technological boundaries.

$216k - $338k

As a Principal Data Scientist on the AI Foundations Specialist Models team, you will be instrumental in building and shipping state-of-the-art, scalable AI/ML solutions for Capital One's award-winning mobile app. You will partner with product, tech, and design teams to deliver dynamic and personalized customer experiences, including enabling interactions with Capital One's digital assistant and enhancing content search capabilities. This role is focused on experimenting with, innovating, and creating next-generation experiences powered by the latest emerging generative AI technologies, driving disruption at a massive scale across billions of customer records.

$162k - $185k

Capital One is building responsible and reliable AI systems to transform banking. We are at the forefront of enterprises leveraging AI, using machine learning to create personalized customer experiences and bring humanity and simplicity to banking. Our Intelligent Foundations and Experiences (IFX) team is central to this vision, building and deploying proprietary AI solutions that deliver value to millions of customers. You will partner with cross-functional teams to deliver AI-powered products, design, develop, test, deploy, and support AI software components, and leverage a broad stack of Open Source and SaaS AI technologies. You will invent and introduce state-of-the-art foundation model optimization techniques to improve the performance of large-scale production AI systems and contribute to the technical vision and roadmap of foundational AI systems.

$230k - $262k

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Consumer & Community Banking Marketing Technology team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.

Salary not listed

As an AI Senior Developer Manager within the Assurance practice, you will lead the development of innovative software solutions to drive digital transformation and enhance business performance. You will focus on designing, coding, and testing applications that revolutionize industries and deliver exceptional user experiences. This role involves motivating, developing, and inspiring your team, coaching members to leverage their strengths and meet client expectations. You will take ownership of projects, ensuring successful planning, budgeting, execution, and completion, while analyzing system interactions and encouraging skill development outside comfort zones. Embracing technology and innovation is key to enhancing delivery and identifying opportunities for the firm's success.

$99k - $252k

Wayve is building the leading AI platform for autonomous driving, pioneering an end-to-end AI approach that enables vehicles to learn directly from real-world experience. This role is on the AI Libraries team, which builds the foundations that enable Wayve's machine learning engineers and researchers to train, evaluate, and deploy models at scale. You will create high-quality platforms, tools, and reusable abstractions that support thousands of GPUs and accelerate the development of autonomous-driving technology. You will work closely with machine learning teams to understand their workflows and translate complex requirements into stable, scalable, and intuitive software. Your day-to-day will involve designing and writing Python, leading projects from discovery through delivery, improving engineering standards, and supporting users as they push the scale and performance of their models. You will build modular libraries for areas such as multimodal data loading, distributed training and inference, checkpointing, and observability, improving the reliability, performance, and developer experience of systems used across Wayve.

$276k - $311k

Black Forest Labs is building the foundational layer for visual intelligence, developing multimodal models trained on images, video, audio, and action. Our team pioneered latent diffusion and Stable Diffusion, making generative AI accessible. We are now pushing into generative media at scale and machines that act in the physical world. This role leads Product Research, bridging researchers and the market. You will analyze signals from evaluations, leaderboards, customers, and usage data to identify areas for model improvement and define the strategy for achieving them. You will work closely with Research, Backend, Product, and Go-to-Market teams.

$172k - $220k

Capital One Canada is seeking an AI Engineer Manager to join their Intelligent Foundations and Experiences (IFX) team. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance both associate workflows and customer interactions. You will be responsible for the design, development, testing, deployment, and support of AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, and governance. The position leverages a variety of Open Source and SaaS AI technologies and requires inventing and implementing state-of-the-art LLM optimization techniques to improve the performance of large-scale production AI systems. You will also contribute to the technical vision and long-term roadmap for foundational AI systems within the company.

$173k - $197k

Cohere

Cohere is seeking a Senior Full-Stack Engineer to join the Cohere Dashboard team. This role is crucial for shaping the user experience of Cohere's platform, which serves as the central hub for users to access models, manage API keys, and explore documentation. You will collaborate with a talented team to build a delightful, intuitive, and unified experience across all dashboard features, contributing to both front-end and back-end development. This is an opportunity to work on mission-critical systems and contribute to the future of large language models.

CA$230k - CA$295k

Capital One Canada is seeking a Principal Associate, AI Engineer to join their Intelligent Foundations and Experiences (IFX) team. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance associate workflows and customer interactions. You will be responsible for designing, developing, testing, deploying, and supporting AI software components, including foundation model training, LLM inference, similarity search, guardrails, model evaluation, and governance. The position leverages a variety of Open Source and SaaS AI technologies and focuses on inventing and implementing state-of-the-art LLM optimization techniques to improve the performance of large-scale production AI systems. You will also contribute to the technical vision and long-term roadmap for foundational AI systems within the company.

$148k - $169k

Databricks

The Foundation Model Inference team is the backbone of Databricks’ generative AI capabilities. We build the infrastructure that enables our customers to serve, scale, and optimize frontier models with enterprise-grade reliability and performance. Our Foundation Model APIs provide a unified platform that gives customers access to LLMs with the governance, flexibility, and scalability required for enterprise production workloads. We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale.

$190k - $265k

Tenstorrent is a leader in AI technology, focusing on performance, ease of use, and cost efficiency. We are building a high-performance RISC-V CPU and a comprehensive AI platform. Join our AI IP software team to help customers integrate AI workloads into products built on Tenstorrent technology. This role involves working directly with customers to integrate models, answer technical questions, and solve integration challenges across models, compilers, and runtime workflows. It's a hands-on software role with opportunities to learn and contribute to cutting-edge AI technology.

Salary not listed

Capital One is building responsible and reliable AI systems to transform banking. We are at the forefront of enterprises leveraging AI, using machine learning to create personalized customer experiences and bring humanity and simplicity to banking. Our Intelligent Foundations and Experiences (IFX) team is central to this vision, advancing the state of the art in AI science and engineering. We build and deploy proprietary solutions that deliver value to millions of customers and empower teams across Capital One with AI capabilities in responsible and scalable ways. You will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses.

$230k - $262k

Capital One is building responsible and reliable AI systems to transform banking. We leverage machine learning for personalized customer experiences and are investing in technology and talent to lead in enterprise AI adoption. Our AI applications bring humanity and simplicity to banking, from fraud detection to real-time customer support. We are committed to building world-class applied science and engineering teams to deliver breakthrough products and scalable AI infrastructure. The Intelligent Foundations and Experiences (IFX) team is central to this vision, advancing AI science and engineering and deploying proprietary solutions that deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance products responsibly and at scale.

$197k - $225k

Capital One is at the forefront of leveraging AI to create responsible and reliable AI systems that are transforming banking. The Intelligent Foundations and Experiences (IFX) team is central to this vision, building and deploying proprietary AI solutions that deliver value to millions of customers. This role will partner with cross-functional teams to deliver AI-powered products, oversee the design and development of AI software components, and make critical build-vs-buy decisions across a broad stack of AI technologies. You will invent and introduce state-of-the-art foundation model optimization techniques, contribute to the technical vision and roadmap of foundational AI systems, and attract and retain top talent in the AI industry. The role also involves scaling AI engineering practices, establishing enterprise standards for Responsible AI, and partnering with research and risk teams to ensure ethical and regulatory compliance.

$245k - $279k

The AI Engineering and Productivity team empowers engineering and quality teams by delivering reliable and secure AI-driven tools. These tools streamline workflows, accelerate decision-making, surface actionable insights, and unlock productivity gains across the product lifecycle. As a Senior Software Engineer, you will develop data-intensive and AI-enabled software applications supporting Product Development engineering teams, working with complex data requirements and delivering solutions using industry-standard practices across SQL, Databricks, and modern programming languages like Java and Python. You will design and build software and data solutions with a strong focus on data quality, performance, and reliability, while also advising, coaching, and mentoring other engineers and shaping how teams access and use data and AI.

Salary not listed

The AI Engineering and Productivity team is seeking a Staff Data Scientist to empower engineering teams with reliable and secure AI-driven tools. This role will streamline workflows, accelerate decision-making, surface insights, and drive productivity gains across the product lifecycle. You will lead AI/ML and data science products, tackling complex problems and translating ambiguous business challenges into scalable, production-grade AI solutions with measurable enterprise impact.

Salary not listed