LLM Engineer Jobs

NVIDIA is seeking a Deep Learning Compiler Intern for 2027 to join our Architecture group. This role involves contributing to the development of cutting-edge GPU architectures and parallel programming models. You will be immersed in a supportive environment focused on innovation and making a lasting impact on the world through AI and accelerated computing.

Salary not listed

NVIDIA is seeking a Senior System Software Engineer with deep expertise in speech technologies to support enterprise and developer customers. This role involves hands-on technical engagement with customers to implement, troubleshoot, and optimize Automatic Speech Recognition (ASR), Text-to-Speech (TTS), Audio Language Models (ALM), and Speech-to-Speech (S2S) systems in production environments. If you're creative and passionate about solving real-world conversational AI problems, join our Speech AI Engineering team at the forefront of technological advancement.

Salary not listed

NVIDIA is seeking skilled interns in artificial intelligence computing solutions to join our AI Compute team in Taiwan. This internship offers the opportunity to work on advanced AI systems, contributing to the development of technologies for Large Language Models, Recommender Systems, and Generative AI, while pushing the limits of GPU performance for AI inference. Interns will focus on specialized tracks within TensorRT-LLM for inference optimization or TensorRT Compiler for graph optimization.

Salary not listed

Haven Safety AI is building an enterprise learning intelligence layer for safety, designed to help high-risk organizations learn faster from incidents and prevent future occurrences. The platform integrates with existing EHS systems to enhance incident investigation, assessment, and learning processes. It leverages current incident evidence, company knowledge, historical cases, and an industry knowledge graph, with specialized AI agents analyzing various data points to produce traceable assessments. This role is a build-and-operate position focused on the AI and LLM engineering layer, connecting the evidence base and knowledge graph to the product experiences used by investigators and safety leaders. The work is technically demanding and operationally critical, serving enterprise customers in regulated, safety-critical industries where precision, traceability, evaluation, and human oversight are paramount.

Salary not listed

The AI Platform team is building the shared runtime for all AI agents at MeridianLink, encompassing model gateway, orchestration, memory, and observability. This role focuses on the trust and explainability layer of this runtime, developing tracing, evaluation, and explanation capabilities. These features will enable engineers to understand multi-agent workflows and allow product teams to provide customers with appropriate explanations to build trust in agent outputs. This is a hands-on engineering role where you will write code for tracing agent actions, adopt and extend open-source frameworks for explainability and observability, and build primitives for surfacing explanations to end-users. You will work closely with a Staff engineer team lead and architects who will support your growth in this area.

$104k - $178k

Capital One is at the forefront of leveraging AI to transform banking, creating responsible and reliable AI systems that enhance customer experiences. The Intelligent Foundations and Experiences (IFX) team is central to this vision, building and deploying proprietary AI solutions that deliver value to millions of customers. This role involves partnering with cross-functional teams to deliver AI-powered products, designing and supporting AI software components, and leveraging a broad stack of AI technologies. You will invent and introduce state-of-the-art foundation model optimization techniques, contribute to the technical vision of foundational AI systems, and design/implement multi-model orchestration pipelines. The ideal candidate is deeply technical, passionate about AI research, and thrives on solving complex, undefined problems.

$230k - $262k

This role sits at the intersection of technical expertise and customer engagement, focused on helping customers and internal teams bring up and optimize AI models on Tenstorrent platforms. As a Software Engineer on the AI Models / System Bring-Up team, you will be responsible for porting, validating, and optimizing AI models on Tenstorrent platforms. Working across models, runtime software, and hardware, you will help connect new models, models not yet running on Tenstorrent hardware, and research-stage workloads to stable, high-performance systems.

Salary not listed

We are seeking an ambitious and self-driven AI Engineering Lead to join our Analytics & AI team. This role is ideal for a passionate technologist with deep expertise in Machine Learning, Artificial Intelligence, and modern software engineering, who is motivated by solving complex, real-world problems and shaping technical direction. As a principal technical specialist, you will design and deliver advanced AI solutions, drive engineering excellence, support business development, and act as the go-to person for technical challenges.

Salary not listed

Crusoe

As a Senior Engineering Manager, you will lead an engineering team focused on making large language models run faster, cheaper, and more reliably in production. This role balances team leadership with core systems and performance engineering on demanding models in production, requiring you to stay deeply technical and hands-on with the inference stack end to end. The work is applied, not academic, with optimizations landing in real customer deployments. You will tailor deployments to customer needs, take workloads from proof of concept to production, and ensure performance gains deliver clear business and customer value. This leadership role combines people management, technical direction, and hands-on coding and profiling, with a customer-facing component and elements of product and technical solutions leadership.

$250k - $300k

Cerebras

Cerebras is developing a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are seeking a Software Engineer to build and enhance the ML API layer, making this heterogeneous serving system accessible, reliable, and user-friendly. You will operate across our inference APIs, model integration layer, request-routing services, and the Cerebras inference platform to ensure a consistent experience across various models and accelerator backends. This role is at the intersection of machine learning systems, API design, model serving, and distributed systems, enabling new model architectures and inference capabilities while defining stable user-facing behavior and ensuring features like streaming, sampling, tool use, structured outputs, and multimodal inputs function correctly in production.

Salary not listed

Capital One is building trustworthy and reliable AI systems to transform banking. We leverage machine learning for real-time, intelligent customer experiences and are committed to world-class applied science and engineering. The AI Foundations team is central to this vision, working across the research lifecycle from academia to production systems. You will partner with cross-functional teams to deliver AI-powered products, using technologies like Pytorch, AWS Ultraclusters, Huggingface, and Lightning to analyze vast amounts of data. This role involves building AI foundation models through all development phases, from design to implementation, and engaging in high-impact applied research to drive next-generation customer experiences.

$263k - $300k

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and platform hardening.

Salary not listed

NVIDIA is seeking a TensorRT-LLM Software Development Engineering intern to join its AI Computing team. This role involves contributing to the development of inferencing software that powers deep learning breakthroughs in areas like LLM, ChatGPT, and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused team and possess excellent interpersonal skills.

Salary not listed

NVIDIA is seeking a Software Development Engineer to contribute to the TensorRT LLM and TensorRT Edge LLM projects within its AI Computing team. This role involves developing inferencing software that powers deep learning-based AI advancements, including LLMs and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused environment and possess excellent interpersonal skills.

Salary not listed

JPMorgan Chase & Co. is seeking a hands-on AI Engineering Lead and domain expert to join the growing Asset and Wealth Management AI Engineering team. This role involves building next-generation technology that leverages JPMC's unique data and full-service advantage to develop high-impact AI applications and platforms within the financial services industry. The ideal candidate will be excited about the opportunity to build cutting-edge business solutions powered by AI, combining proven development expertise with a passion for creating innovative technology through solid engineering practices.

Salary not listed

We are seeking an Engineering Manager for AI/ML to lead Rula's AI Engineering team, focusing on both applied product capabilities and foundational ML platforms. This role involves guiding senior and staff engineers to deliver user-facing features like transcript summarization and search relevance, while also architecting core AI/ML infrastructure such as feature stores and AI observability platforms. The ideal candidate will balance execution speed, strong coaching, and a rigorous sense of clinical safety to ensure solutions and models scale effectively and safely. You will be instrumental in shaping Rula's AI engineering culture and driving technological advancements that transform mental healthcare delivery.

$208k - $260k

EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the development and optimization of graph compilers tailored for cutting-edge AI and ML workloads. This role involves collaborating with hardware architects and AI researchers to enhance performance, optimize computation graphs, and enable efficient model deployment on EnCharge's Inference Accelerators. The ideal candidate will architect, design, and implement optimizations for AI model execution on graph compilers to improve performance, reduce latency, and maximize hardware utilization.

$190k - $255k

Capital One is seeking an Applied Researcher to join the AI Foundations team, focusing on LLM, Optimization, and Finetuning. This role involves partnering with cross-functional teams to deliver AI-powered products that enhance customer interactions with their money. You will leverage a broad stack of technologies, including Pytorch, AWS Ultraclusters, Huggingface, and Lightning, to analyze vast amounts of data and build AI foundation models through all phases of development. The position offers the opportunity to engage in high-impact applied research, pushing the boundaries of AI for next-generation customer experiences and translating complex work into tangible business goals. Collaboration with senior researchers for tech reports and conference submissions is also a key aspect of the role.

$219k - $250k

Databricks

As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API. You’ll bridge research advances and production demands, ensuring high throughput, low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with frameworks and orchestration systems.

$191k - $233k

Databricks

Databricks is seeking a Fullstack Software Engineer to join its new R&D center in Vancouver, Canada. This role involves working on the company's mission to simplify and democratize data and AI by building and running the world's best data and AI infrastructure platform. You will collaborate with your team and product management to make data insights simple, taking ownership of the full product and user experience beyond technical implementation. The Vancouver site is envisioned as a key driver of product innovation, with open roles across strategic areas like Log Analytics, AI/BI, Unity Catalog Business Semantics, and Databricks Apps, the latter of which heavily invests in app builder AI agents.

CA$146k - CA$201k

Hugging Face is seeking a Senior Open-Source Python Engineer to join their Applications team, focusing on building tooling for developers to create machine learning applications. This role involves maintaining and growing existing libraries like Trackio and Gradio, as well as developing new tools from scratch. A significant part of the job is taking projects from early stages to widespread adoption by shaping APIs, shipping quickly, and engaging with the developer community. The position is dynamic and requires comfort with evolving challenges in the rapidly changing ML ecosystem.

Salary not listed

Handshake is seeking a Senior Software Engineer to join the Backend Platform team, with a primary focus on supporting Handshake AI (HAI) and internal AI initiatives. This role involves building and maintaining backend services, shared platform capabilities, and developer tooling. The work will center on core backend platform concerns such as service architecture, APIs, data systems, performance, reliability, and developer experience, with an increasing use of LLMs and agents. The ideal candidate will possess strong backend fundamentals combined with practical knowledge of LLM-powered and agentic systems.

$208k - $260k

Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team, which is central to bringing the company's AI vision to life. This role involves partnering with cross-functional teams to deliver AI-powered products that transform customer interactions and associate workflows. You will design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, model evaluation, and governance. The position leverages a broad stack of Open Source and SaaS AI technologies and focuses on inventing and introducing state-of-the-art foundation model optimization techniques to enhance the performance of large-scale production AI systems. You will also contribute to the technical vision and roadmap for foundational AI systems, design and optimize multi-model orchestration pipelines, and establish cost-performance governance for AI systems.

$230k - $262k

Capital One is building responsible and reliable AI systems to transform banking. We are at the forefront of enterprises leveraging AI, using machine learning to create personalized customer experiences and bring humanity and simplicity to banking. You will join a world-class applied science and engineering team to deliver breakthrough product experiences and scalable, high-performance AI infrastructure. The Intelligent Foundations and Experiences (IFX) team is central to this vision, advancing the state of the art in AI science and engineering, and building proprietary solutions that deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with AI in responsible and scalable ways.

$197k - $225k