Senior LLM Engineer Jobs

Join NVIDIA at the forefront of AI compiler technology and help shape the future of accelerated computing. We are building Thunder, an ambitious source-to-source compiler designed to unlock outstanding performance for PyTorch models on NVIDIA GPUs. This role offers a unique opportunity to contribute to the PyTorch ecosystem, working with modern compiler stacks like PyTorch 2.0's TorchDynamo and TorchInductor to create powerful, open-source solutions. If you are driven to solve complex problems and want to make a foundational impact on the AI ecosystem, apply to join our collaborative and innovative team.

€112k - €194k

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!

$375k - $650k

Anduril Industries

Anduril Industries is seeking an Applied LLM Systems Engineer to design, build, and operate production AI systems that enhance the creation, transformation, validation, maintenance, and delivery of technical documentation. This role focuses on building AI-assisted authoring, automated publishing, and multi-agent coordination tools for the Technical Publications pipeline. It requires a systems-engineering approach for someone experienced in delivering production AI systems, understanding evaluation and rollback, and managing probabilistic systems in enterprise environments with strict requirements. The goal is to expand system capability while optimizing token usage, context efficiency, and cost at scale.

$191k - $254k

Datadog

The Datadog Agent is our flagship open-source project and a critical part of how customers experience Datadog, with hundreds of engineers contributing annually across multiple languages and platforms. As Manager II, Engineering for Datadog Agent SDLC, you will lead the systems, tooling, and developer experience that enable engineers to build, test, secure, and ship software that runs in customer environments. You will guide the evolution of our software development lifecycle as AI coding tools reshape how software is developed, while strengthening our approach to software supply-chain security, build infrastructure, correctness, and performance. This is an opportunity to shape engineering practices for the Agent and establish patterns that can influence other open-source projects across Datadog.

$244k - $305k

CoreWeave

CoreWeave is seeking a Senior Software Engineer focused on Inference to join their team. In this role, you will be an area owner, responsible for leading designs, elevating engineering standards, and delivering significant improvements in latency, throughput, and reliability across multiple services. You will collaborate with product, orchestration, and hardware teams to enhance our Kubernetes-native inference platform and meet stringent P99 SLAs at scale. This is an opportunity to work on a cutting-edge AI cloud platform during a period of hyper-growth, contributing to innovative solutions for complex problems.

$152k - $204k

NVIDIA is seeking a Manager, Deep Learning Inference Software to lead a team focused on advancing AI model deployment. This role involves shaping software for sophisticated AI systems, including large language models and multimodal generative AI, accelerated on NVIDIA GPUs. The team develops and optimizes open-source frameworks like vLLM/SGLang and FlashInfer to make AI deployment scalable, efficient, and accessible, enabling real-time inference at all scales. The position offers a chance to work with forward-thinking individuals and provides opportunities for career advancement in a rapidly growing company.

$184k - $357k

CoreWeave

CoreWeave is seeking a Senior Software Engineer I, Inference to join their AI Cloud team. This role involves owning specific areas of the inference platform, leading design efforts, and improving latency, throughput, and reliability. You will collaborate with product, orchestration, and hardware teams to enhance a Kubernetes-native inference platform and meet strict service level agreements at scale. The position requires a strong focus on engineering standards, incident management, and mentoring junior engineers.

$139k - $204k

NVIDIA is seeking a Senior Developer Relations Manager to drive the adoption of its Cosmos 3 and Cosmos world foundation models within the Robotics ecosystem. This role involves building strong technical relationships with strategic partners and the NVIDIA Cosmos Coalition community, guiding developers in applying these models for robotics and autonomous systems. The ideal candidate will possess deep technical knowledge, adaptability, and expertise in guiding architecture and implementation plans for physical AI, world foundation models, and robot learning.

$184k - $357k

Join NVIDIA's Analytics and Data Intelligence (ADI) group to develop "libcudf," an open-source CUDA C++ library that accelerates database and DataFrame operations. This role involves driving speed-of-light performance in structured data processing across various hardware, from single workstations to multi-node GPU supercomputers. You will build the computational core for DataFrame and database accelerators, creating highly optimized C++ and CUDA libraries that leverage GPU parallelism for operations like data loading, parsing, joins, and aggregations. This is an opportunity to contribute to an open-source software suite and make a significant impact.

$184k - $357k

NVIDIA is building a unified foundation model that understands relational databases and heterogeneous graphs, enabling a new era of enterprise AI. This role involves designing, building, and evaluating novel Transformer and graph neural network architectures that generalize across diverse data schemas. The work will power applications like recommendation systems, demand forecasting, fraud detection, and predictive maintenance. You will collaborate with researchers and engineers across the entire machine learning lifecycle, from architecture exploration and large-scale training to post-training optimization and high-performance inference, translating foundational research into production systems.

$184k - $357k

NVIDIA is seeking software engineers for its Deep Learning Frameworks Sustaining Engineering team. This role involves working directly with deep learning framework developers to integrate with open source codebases, contributing to software that powers breakthroughs in areas like image classification, speech recognition, and natural language processing. The team's work enables advancements used globally, making this a significant opportunity to impact the field of deep learning.

$152k - $288k

We are seeking a Senior System Software Engineer to contribute to the development of the Dynamo-Triton Inference Server. This role is part of NVIDIA's GPU-accelerated deep learning software team, which is building a high-performance AI inference platform to simplify the design and deployment of AI models. The platform aims to make AI models more accessible to all users and is crucial for enabling breakthroughs in various AI fields, including image classification, speech recognition, and natural language processing.

$152k - $288k

NVIDIA is seeking a Senior Backend Compiler Engineer to join our GPU Software organization. This role focuses on constructing and emitting high-performance GPU machine instructions for Graphics and Compute applications. You will be instrumental in designing and implementing a new LLVM-based JIT compiler targeting NVIDIA GPUs, developing new compiler passes and optimizations, and collaborating with global teams to drive improvements and problem resolution. This is an opportunity to apply and adapt cutting-edge compiler technologies to produce premier, robust compiler tools and influence new GPU architectures.

$152k - $242k

NVIDIA is seeking a Senior Engineering Manager to lead and define the company's JAX strategy. This role involves coordinating multiple teams and workstreams to ensure JAX delivers peak performance across NVIDIA's evolving datacenter infrastructure, which includes GPUs, CPUs, and LPUs. The position is critical for ensuring JAX is ready on next-generation architectures and supports emerging AI needs across training, post-training, inference, and robotics, bridging new hardware capabilities with AI trends.

$272k - $431k

NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware and software stack. This role sits at the intersection of distributed training, GPU architecture, systems software, deep learning frameworks, and performance engineering. You will analyze and optimize frontier-scale LLM workloads running on thousands of GPUs, drive improvements across frameworks such as PyTorch, JAX, NeMo, and NeMo RL, and use insights from real workloads to help shape future NVIDIA GPU, system, and software roadmaps. We are looking for a deeply technical leader who can operate across abstraction layers: from application-level training behavior to framework/runtime internals, CUDA libraries, communication collectives, memory systems, networking, and GPU architecture. At this level, success means both directly improving performance directly as well as setting technical direction, raising the bar for the organization, and influencing multi-functional decisions across NVIDIA.

$272k - $431k

NVIDIA is seeking a Senior AI Frameworks Engineer to join the CUTLASS team, a popular open-source ecosystem for high-performance math primitives on NVIDIA GPUs. This role focuses on developing Pythonic CUTLASS (CUTLASS DSL), aiming to bring high-performance abstractions directly into the Python environment. You will bridge the gap between low-level hardware primitives and high-level developer productivity, empowering AI researchers and engineers with better tools. If you are passionate about building elegant, high-performance DSLs, this is an opportunity to contribute to the next frontier of GPU programming.

$152k - $288k

NVIDIA is seeking an AI Compiler Engineer with deep expertise in compiler technologies to join their team. This role focuses on building AI-driven compiler intelligence for production compiler pipelines, aiming to deliver measurable improvements in performance and efficiency. The engineer will advance LLM-enabled workflows for compiler decisioning and developer productivity, working within a diverse and supportive environment that fosters innovation. The position involves collaborating with world-class engineers to shape next-generation compiler capabilities that power large-scale, high-impact products.

$184k - $288k

NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.

$272k - $489k

NVIDIA is seeking a Senior AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves analyzing deep learning networks and developing compiler optimization algorithms to power the next era of AI computing. The DLC is a critical component for NVIDIA's inference engine, enabling breakthroughs across various AI domains. The compiler must deliver leading inference performance, fast build times, reduced memory footprints, and ease of use for both Ahead-of-Time and Just-in-Time compilation. You will be part of a team building a compiler used by the global deep learning community, impacting data centers, personal devices, automotive, and robotics.

$152k - $242k

NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team, focusing on geometric and semantic understanding, and reasoning for robots. You will build perception systems that transform raw sensor data into actionable world understanding, contributing to the future of physical AI. This role involves designing, implementing, and deploying novel algorithms for spatial understanding, developing robust perception, mapping, and reasoning systems, and advancing the state of the art in geometric computer vision by combining classical multi-view geometry with deep learning. You will also train and evaluate vision-language models for robotics skills and collaborate with various teams to integrate and release applied research efforts.

$184k - $357k

NVIDIA is seeking a Senior Compiler Engineer to join a team focused on the next generation of GPU systems programming. This role involves redefining how developers create high-performance GPU software by integrating the safety, expressiveness, and modern tooling of Rust into native GPU and CUDA development. You will be instrumental in building advanced compiler pipelines, custom intermediate representation (IR) frameworks, and JIT compilation systems that connect host and device execution, enabling developers to write memory-safe, high-performance GPU kernels using idiomatic Rust.

$152k - $242k

NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads. This role focuses on optimizing NVIDIA’s high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance training on thousands of GPUs. You will also help shape hardware roadmaps for the next generation of GPUs powering the AI revolution. This is an opportunity to collaborate with forward-thinking individuals and shape the future of AI in a creative and autonomous work environment.

$184k - $357k

NVIDIA is seeking a Senior Compiler Engineer to join our GPU Software organization. In this role, you will be instrumental in delivering features and improvements that maximize the potential of NVIDIA hardware across diverse computational workloads, including deep learning, scientific computing, autonomous vehicles, and gaming. Our compiler organization plays a critical role in every GPU NVIDIA produces. You will focus on the CUDA compiler front end, developing language features, diagnostics, and capabilities that empower both human developers and AI agents to create correct and high-performance GPU code. This position offers the opportunity to expand your expertise into other areas of the compiler stack, such as the LLVM-based optimizer, code generation, and MLIR.

$152k - $242k

We are seeking a Senior Forward Deployed Engineer to lead technical engagements with partners and customers, focusing on NVIDIA's open model portfolio. The primary mission is to transform open models into production-ready AI solutions tailored to specific domains, covering the entire lifecycle from post-training to harness optimization. This role involves collaborating closely with NVIDIA's partner ecosystem, co-leading customer engagements, and developing resources that enable partners to scale their AI initiatives. You will work hands-on to build custom AI solutions, from initial customer conversations through to production deployment, ensuring models are optimized for performance and cost-effectiveness.

$184k - $357k