LLM Engineer Jobs

Join NVIDIA at the forefront of AI compiler technology and help shape the future of accelerated computing. We are building Thunder, an ambitious source-to-source compiler designed to unlock outstanding performance for PyTorch models on NVIDIA GPUs. This role offers a unique opportunity to contribute to the PyTorch ecosystem, working with modern compiler stacks like PyTorch 2.0's TorchDynamo and TorchInductor to create powerful, open-source solutions. If you are driven to solve complex problems and want to make a foundational impact on the AI ecosystem, apply to join our collaborative and innovative team.

€112k - €194k

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs, RAG, agents, and vision models. You will collaborate across the organization to bring the latest flagship models from our community and partners to life. This role offers an outstanding opportunity to craft the future of AI at a fast-growing company at the forefront of the AI revolution. Join our team of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, enterprise-grade GPU clusters capable of hundreds of PetaFLOPS and gain early access to unreleased hardware, making a direct impact on NVIDIA's roadmap and the broader AI landscape!

$375k - $650k

NVIDIA is seeking a GenAI Algorithms Intern to optimize state-of-the-art generative AI models, including LLMs, VLMs, and diffusion models, for maximum inference efficiency. This role involves designing, implementing, and productionizing model optimization algorithms for deployment on NVIDIA's latest hardware. The focus is on improving ease of use, compute and memory efficiency, and achieving optimal accuracy-performance trade-offs through software-hardware co-design. Your work will span multiple layers of the AI software stack, from algorithm design to integration within NVIDIA's ecosystem and open-source frameworks, with potential for GPU-level optimization including custom kernel development.

$118k - $261k

Anduril Industries

Anduril Industries is seeking an Applied LLM Systems Engineer to design, build, and operate production AI systems that enhance the creation, transformation, validation, maintenance, and delivery of technical documentation. This role focuses on building AI-assisted authoring, automated publishing, and multi-agent coordination tools for the Technical Publications pipeline. It requires a systems-engineering approach for someone experienced in delivering production AI systems, understanding evaluation and rollback, and managing probabilistic systems in enterprise environments with strict requirements. The goal is to expand system capability while optimizing token usage, context efficiency, and cost at scale.

$191k - $254k

SpaceX is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role focuses on the most critical post-training and reinforcement learning challenges, including reward modeling, preference optimization (RLHF/DPO), and RL for improving reasoning, truthfulness, and real-world capabilities. You will work on cutting-edge AI problems with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

$180k - $600k

Datadog

The Datadog Agent is our flagship open-source project and a critical part of how customers experience Datadog, with hundreds of engineers contributing annually across multiple languages and platforms. As Manager II, Engineering for Datadog Agent SDLC, you will lead the systems, tooling, and developer experience that enable engineers to build, test, secure, and ship software that runs in customer environments. You will guide the evolution of our software development lifecycle as AI coding tools reshape how software is developed, while strengthening our approach to software supply-chain security, build infrastructure, correctness, and performance. This is an opportunity to shape engineering practices for the Agent and establish patterns that can influence other open-source projects across Datadog.

$244k - $305k

CoreWeave

CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.

$92k - $135k

NVIDIA is seeking a Manager, Deep Learning Inference Software to lead a team focused on advancing AI model deployment. This role involves shaping software for sophisticated AI systems, including large language models and multimodal generative AI, accelerated on NVIDIA GPUs. The team develops and optimizes open-source frameworks like vLLM/SGLang and FlashInfer to make AI deployment scalable, efficient, and accessible, enabling real-time inference at all scales. The position offers a chance to work with forward-thinking individuals and provides opportunities for career advancement in a rapidly growing company.

$184k - $357k

SpaceXSI is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role is at the intersection of engineering and data operations, focusing on ensuring engineering teams receive high-quality data for training and evaluation. You will partner with model teams, design projects to capture meaningful signals, and drive data yield and evaluation lift, influencing data strategy through hands-on technical work.

$144k - $220k

CoreWeave

CoreWeave is seeking a Senior Software Engineer focused on Inference to join their team. In this role, you will be an area owner, responsible for leading designs, elevating engineering standards, and delivering significant improvements in latency, throughput, and reliability across multiple services. You will collaborate with product, orchestration, and hardware teams to enhance our Kubernetes-native inference platform and meet stringent P99 SLAs at scale. This is an opportunity to work on a cutting-edge AI cloud platform during a period of hyper-growth, contributing to innovative solutions for complex problems.

$152k - $204k

NVIDIA is seeking a Senior Developer Relations Manager to drive the adoption of its Cosmos 3 and Cosmos world foundation models within the Robotics ecosystem. This role involves building strong technical relationships with strategic partners and the NVIDIA Cosmos Coalition community, guiding developers in applying these models for robotics and autonomous systems. The ideal candidate will possess deep technical knowledge, adaptability, and expertise in guiding architecture and implementation plans for physical AI, world foundation models, and robot learning.

$184k - $357k

CoreWeave

CoreWeave is seeking a Senior Software Engineer I, Inference to join their AI Cloud team. This role involves owning specific areas of the inference platform, leading design efforts, and improving latency, throughput, and reliability. You will collaborate with product, orchestration, and hardware teams to enhance a Kubernetes-native inference platform and meet strict service level agreements at scale. The position requires a strong focus on engineering standards, incident management, and mentoring junior engineers.

$139k - $204k

Join NVIDIA's Analytics and Data Intelligence (ADI) group to develop "libcudf," an open-source CUDA C++ library that accelerates database and DataFrame operations. This role involves driving speed-of-light performance in structured data processing across various hardware, from single workstations to multi-node GPU supercomputers. You will build the computational core for DataFrame and database accelerators, creating highly optimized C++ and CUDA libraries that leverage GPU parallelism for operations like data loading, parsing, joins, and aggregations. This is an opportunity to contribute to an open-source software suite and make a significant impact.

$184k - $357k

NVIDIA is building a unified foundation model that understands relational databases and heterogeneous graphs, enabling a new era of enterprise AI. This role involves designing, building, and evaluating novel Transformer and graph neural network architectures that generalize across diverse data schemas. The work will power applications like recommendation systems, demand forecasting, fraud detection, and predictive maintenance. You will collaborate with researchers and engineers across the entire machine learning lifecycle, from architecture exploration and large-scale training to post-training optimization and high-performance inference, translating foundational research into production systems.

$184k - $357k

NVIDIA is seeking software engineers for its Deep Learning Frameworks Sustaining Engineering team. This role involves working directly with deep learning framework developers to integrate with open source codebases, contributing to software that powers breakthroughs in areas like image classification, speech recognition, and natural language processing. The team's work enables advancements used globally, making this a significant opportunity to impact the field of deep learning.

$152k - $288k

We are seeking a Senior System Software Engineer to contribute to the development of the Dynamo-Triton Inference Server. This role is part of NVIDIA's GPU-accelerated deep learning software team, which is building a high-performance AI inference platform to simplify the design and deployment of AI models. The platform aims to make AI models more accessible to all users and is crucial for enabling breakthroughs in various AI fields, including image classification, speech recognition, and natural language processing.

$152k - $288k

NVIDIA is seeking a Senior Backend Compiler Engineer to join our GPU Software organization. This role focuses on constructing and emitting high-performance GPU machine instructions for Graphics and Compute applications. You will be instrumental in designing and implementing a new LLVM-based JIT compiler targeting NVIDIA GPUs, developing new compiler passes and optimizations, and collaborating with global teams to drive improvements and problem resolution. This is an opportunity to apply and adapt cutting-edge compiler technologies to produce premier, robust compiler tools and influence new GPU architectures.

$152k - $242k

NVIDIA is seeking a Senior Engineering Manager to lead and define the company's JAX strategy. This role involves coordinating multiple teams and workstreams to ensure JAX delivers peak performance across NVIDIA's evolving datacenter infrastructure, which includes GPUs, CPUs, and LPUs. The position is critical for ensuring JAX is ready on next-generation architectures and supports emerging AI needs across training, post-training, inference, and robotics, bridging new hardware capabilities with AI trends.

$272k - $431k

NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware and software stack. This role sits at the intersection of distributed training, GPU architecture, systems software, deep learning frameworks, and performance engineering. You will analyze and optimize frontier-scale LLM workloads running on thousands of GPUs, drive improvements across frameworks such as PyTorch, JAX, NeMo, and NeMo RL, and use insights from real workloads to help shape future NVIDIA GPU, system, and software roadmaps. We are looking for a deeply technical leader who can operate across abstraction layers: from application-level training behavior to framework/runtime internals, CUDA libraries, communication collectives, memory systems, networking, and GPU architecture. At this level, success means both directly improving performance directly as well as setting technical direction, raising the bar for the organization, and influencing multi-functional decisions across NVIDIA.

$272k - $431k

NVIDIA is seeking a Senior AI Frameworks Engineer to join the CUTLASS team, a popular open-source ecosystem for high-performance math primitives on NVIDIA GPUs. This role focuses on developing Pythonic CUTLASS (CUTLASS DSL), aiming to bring high-performance abstractions directly into the Python environment. You will bridge the gap between low-level hardware primitives and high-level developer productivity, empowering AI researchers and engineers with better tools. If you are passionate about building elegant, high-performance DSLs, this is an opportunity to contribute to the next frontier of GPU programming.

$152k - $288k

NVIDIA is seeking an AI Compiler Engineer with deep expertise in compiler technologies to join their team. This role focuses on building AI-driven compiler intelligence for production compiler pipelines, aiming to deliver measurable improvements in performance and efficiency. The engineer will advance LLM-enabled workflows for compiler decisioning and developer productivity, working within a diverse and supportive environment that fosters innovation. The position involves collaborating with world-class engineers to shape next-generation compiler capabilities that power large-scale, high-impact products.

$184k - $288k

NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.

$272k - $489k

NVIDIA is seeking a Senior AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves analyzing deep learning networks and developing compiler optimization algorithms to power the next era of AI computing. The DLC is a critical component for NVIDIA's inference engine, enabling breakthroughs across various AI domains. The compiler must deliver leading inference performance, fast build times, reduced memory footprints, and ease of use for both Ahead-of-Time and Just-in-Time compilation. You will be part of a team building a compiler used by the global deep learning community, impacting data centers, personal devices, automotive, and robotics.

$152k - $242k

NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team, focusing on geometric and semantic understanding, and reasoning for robots. You will build perception systems that transform raw sensor data into actionable world understanding, contributing to the future of physical AI. This role involves designing, implementing, and deploying novel algorithms for spatial understanding, developing robust perception, mapping, and reasoning systems, and advancing the state of the art in geometric computer vision by combining classical multi-view geometry with deep learning. You will also train and evaluate vision-language models for robotics skills and collaborate with various teams to integrate and release applied research efforts.

$184k - $357k