LLM Engineer Jobs in San Francisco

SpaceX is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role focuses on the most critical post-training and reinforcement learning challenges, including reward modeling, preference optimization (RLHF/DPO), and RL for improving reasoning, truthfulness, and real-world capabilities. You will work on cutting-edge AI problems with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

$180k - $600k

CoreWeave

CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.

$92k - $135k

NVIDIA is seeking a Manager, Deep Learning Inference Software to lead a team focused on advancing AI model deployment. This role involves shaping software for sophisticated AI systems, including large language models and multimodal generative AI, accelerated on NVIDIA GPUs. The team develops and optimizes open-source frameworks like vLLM/SGLang and FlashInfer to make AI deployment scalable, efficient, and accessible, enabling real-time inference at all scales. The position offers a chance to work with forward-thinking individuals and provides opportunities for career advancement in a rapidly growing company.

$184k - $357k

SpaceXSI is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role is at the intersection of engineering and data operations, focusing on ensuring engineering teams receive high-quality data for training and evaluation. You will partner with model teams, design projects to capture meaningful signals, and drive data yield and evaluation lift, influencing data strategy through hands-on technical work.

$144k - $220k

CoreWeave

CoreWeave is seeking a Senior Software Engineer focused on Inference to join their team. In this role, you will be an area owner, responsible for leading designs, elevating engineering standards, and delivering significant improvements in latency, throughput, and reliability across multiple services. You will collaborate with product, orchestration, and hardware teams to enhance our Kubernetes-native inference platform and meet stringent P99 SLAs at scale. This is an opportunity to work on a cutting-edge AI cloud platform during a period of hyper-growth, contributing to innovative solutions for complex problems.

$152k - $204k

NVIDIA is seeking a Senior Developer Relations Manager to drive the adoption of its Cosmos 3 and Cosmos world foundation models within the Robotics ecosystem. This role involves building strong technical relationships with strategic partners and the NVIDIA Cosmos Coalition community, guiding developers in applying these models for robotics and autonomous systems. The ideal candidate will possess deep technical knowledge, adaptability, and expertise in guiding architecture and implementation plans for physical AI, world foundation models, and robot learning.

$184k - $357k

CoreWeave

CoreWeave is seeking a Senior Software Engineer I, Inference to join their AI Cloud team. This role involves owning specific areas of the inference platform, leading design efforts, and improving latency, throughput, and reliability. You will collaborate with product, orchestration, and hardware teams to enhance a Kubernetes-native inference platform and meet strict service level agreements at scale. The position requires a strong focus on engineering standards, incident management, and mentoring junior engineers.

$139k - $204k

Join NVIDIA's Analytics and Data Intelligence (ADI) group to develop "libcudf," an open-source CUDA C++ library that accelerates database and DataFrame operations. This role involves driving speed-of-light performance in structured data processing across various hardware, from single workstations to multi-node GPU supercomputers. You will build the computational core for DataFrame and database accelerators, creating highly optimized C++ and CUDA libraries that leverage GPU parallelism for operations like data loading, parsing, joins, and aggregations. This is an opportunity to contribute to an open-source software suite and make a significant impact.

$184k - $357k

NVIDIA is building a unified foundation model that understands relational databases and heterogeneous graphs, enabling a new era of enterprise AI. This role involves designing, building, and evaluating novel Transformer and graph neural network architectures that generalize across diverse data schemas. The work will power applications like recommendation systems, demand forecasting, fraud detection, and predictive maintenance. You will collaborate with researchers and engineers across the entire machine learning lifecycle, from architecture exploration and large-scale training to post-training optimization and high-performance inference, translating foundational research into production systems.

$184k - $357k

NVIDIA is seeking software engineers for its Deep Learning Frameworks Sustaining Engineering team. This role involves working directly with deep learning framework developers to integrate with open source codebases, contributing to software that powers breakthroughs in areas like image classification, speech recognition, and natural language processing. The team's work enables advancements used globally, making this a significant opportunity to impact the field of deep learning.

$152k - $288k

We are seeking a Senior System Software Engineer to contribute to the development of the Dynamo-Triton Inference Server. This role is part of NVIDIA's GPU-accelerated deep learning software team, which is building a high-performance AI inference platform to simplify the design and deployment of AI models. The platform aims to make AI models more accessible to all users and is crucial for enabling breakthroughs in various AI fields, including image classification, speech recognition, and natural language processing.

$152k - $288k

NVIDIA is seeking a Senior Backend Compiler Engineer to join our GPU Software organization. This role focuses on constructing and emitting high-performance GPU machine instructions for Graphics and Compute applications. You will be instrumental in designing and implementing a new LLVM-based JIT compiler targeting NVIDIA GPUs, developing new compiler passes and optimizations, and collaborating with global teams to drive improvements and problem resolution. This is an opportunity to apply and adapt cutting-edge compiler technologies to produce premier, robust compiler tools and influence new GPU architectures.

$152k - $242k

NVIDIA is seeking a Senior Engineering Manager to lead and define the company's JAX strategy. This role involves coordinating multiple teams and workstreams to ensure JAX delivers peak performance across NVIDIA's evolving datacenter infrastructure, which includes GPUs, CPUs, and LPUs. The position is critical for ensuring JAX is ready on next-generation architectures and supports emerging AI needs across training, post-training, inference, and robotics, bridging new hardware capabilities with AI trends.

$272k - $431k

NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware and software stack. This role sits at the intersection of distributed training, GPU architecture, systems software, deep learning frameworks, and performance engineering. You will analyze and optimize frontier-scale LLM workloads running on thousands of GPUs, drive improvements across frameworks such as PyTorch, JAX, NeMo, and NeMo RL, and use insights from real workloads to help shape future NVIDIA GPU, system, and software roadmaps. We are looking for a deeply technical leader who can operate across abstraction layers: from application-level training behavior to framework/runtime internals, CUDA libraries, communication collectives, memory systems, networking, and GPU architecture. At this level, success means both directly improving performance directly as well as setting technical direction, raising the bar for the organization, and influencing multi-functional decisions across NVIDIA.

$272k - $431k

NVIDIA is seeking a Senior AI Frameworks Engineer to join the CUTLASS team, a popular open-source ecosystem for high-performance math primitives on NVIDIA GPUs. This role focuses on developing Pythonic CUTLASS (CUTLASS DSL), aiming to bring high-performance abstractions directly into the Python environment. You will bridge the gap between low-level hardware primitives and high-level developer productivity, empowering AI researchers and engineers with better tools. If you are passionate about building elegant, high-performance DSLs, this is an opportunity to contribute to the next frontier of GPU programming.

$152k - $288k

NVIDIA is seeking a senior software engineer for its AI Networking Codesign and Benchmarking R&D group. In this role, you will be responsible for profiling, analyzing, and optimizing AI workloads on large-scale GPU and CPU clusters, focusing on distributed Deep Learning LLM training and inference. Your work will center on collective communication and networking, involving collaboration across hardware components like HCAs, Switches, CPUs, and GPUs, as well as software layers including LLM applications, machine learning frameworks, and communication libraries. You will also develop performance analysis tools and strategies to identify and clarify performance expectations, limitations, and bottlenecks, contributing directly to AI innovation.

$272k - $489k

NVIDIA is seeking a Senior AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves analyzing deep learning networks and developing compiler optimization algorithms to power the next era of AI computing. The DLC is a critical component for NVIDIA's inference engine, enabling breakthroughs across various AI domains. The compiler must deliver leading inference performance, fast build times, reduced memory footprints, and ease of use for both Ahead-of-Time and Just-in-Time compilation. You will be part of a team building a compiler used by the global deep learning community, impacting data centers, personal devices, automotive, and robotics.

$152k - $242k

NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team, focusing on geometric and semantic understanding, and reasoning for robots. You will build perception systems that transform raw sensor data into actionable world understanding, contributing to the future of physical AI. This role involves designing, implementing, and deploying novel algorithms for spatial understanding, developing robust perception, mapping, and reasoning systems, and advancing the state of the art in geometric computer vision by combining classical multi-view geometry with deep learning. You will also train and evaluate vision-language models for robotics skills and collaborate with various teams to integrate and release applied research efforts.

$184k - $357k

NVIDIA is seeking a Senior Compiler Engineer to join a team focused on the next generation of GPU systems programming. This role involves redefining how developers create high-performance GPU software by integrating the safety, expressiveness, and modern tooling of Rust into native GPU and CUDA development. You will be instrumental in building advanced compiler pipelines, custom intermediate representation (IR) frameworks, and JIT compilation systems that connect host and device execution, enabling developers to write memory-safe, high-performance GPU kernels using idiomatic Rust.

$152k - $242k

NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads. This role focuses on optimizing NVIDIA’s high-performance LLM software stack in frameworks like PyTorch and JAX for high-performance training on thousands of GPUs. You will also help shape hardware roadmaps for the next generation of GPUs powering the AI revolution. This is an opportunity to collaborate with forward-thinking individuals and shape the future of AI in a creative and autonomous work environment.

$184k - $357k

NVIDIA is seeking a Senior Compiler Engineer to join our GPU Software organization. In this role, you will be instrumental in delivering features and improvements that maximize the potential of NVIDIA hardware across diverse computational workloads, including deep learning, scientific computing, autonomous vehicles, and gaming. Our compiler organization plays a critical role in every GPU NVIDIA produces. You will focus on the CUDA compiler front end, developing language features, diagnostics, and capabilities that empower both human developers and AI agents to create correct and high-performance GPU code. This position offers the opportunity to expand your expertise into other areas of the compiler stack, such as the LLVM-based optimizer, code generation, and MLIR.

$152k - $242k

We are seeking a Senior Forward Deployed Engineer to lead technical engagements with partners and customers, focusing on NVIDIA's open model portfolio. The primary mission is to transform open models into production-ready AI solutions tailored to specific domains, covering the entire lifecycle from post-training to harness optimization. This role involves collaborating closely with NVIDIA's partner ecosystem, co-leading customer engagements, and developing resources that enable partners to scale their AI initiatives. You will work hands-on to build custom AI solutions, from initial customer conversations through to production deployment, ensuring models are optimized for performance and cost-effectiveness.

$184k - $357k

NVIDIA is seeking software engineers for the Tensor IR & CUDA Tile team to work on compiler technologies for NVIDIA GPUs. These technologies are central to the deep learning revolution, enabling breakthroughs in generative AI, large language models, and other critical areas. You will join a top-notch team with broad impact across the deep learning community, contributing to the next era of computing where AI drives innovation.

$152k - $242k

NVIDIA is seeking a Senior Software Engineer to enhance the Rust experience for CUDA Core Libraries. This role involves designing and implementing safe, idiomatic Rust APIs for GPU computing, while integrating closely with existing C/C++ components. You will be part of the team responsible for building the foundational libraries, algorithms, and infrastructure that power CUDA, ensuring a high-performance experience for developers and AI coding agents.

$184k - $357k