AI Infrastructure Engineer Jobs in San Francisco

The AI revolution is driven by computation that is fast, efficient, and economical. At NVIDIA, performance is paramount, and the CUDA driver is a critical layer where architectural invention becomes useful computing. This team has a unique opportunity to impact numerous downstream systems and products by optimizing fundamental aspects of the CUDA driver and runtime. We are seeking systems software engineers to design and implement production C/C++ features and optimizations within the CUDA driver and runtime. You will trace workloads across various system boundaries, bring up new platforms, and translate evidence into future software and hardware direction, ultimately making AI tools more responsive and efficient.

$124k - $196k

NVIDIA is seeking Architects, Functional Modeling Engineers, and Simulation experts to join its Architecture Modeling group. In this role, you will collaborate with world-class architects to enable functional simulation platforms across GPU generations. You will be instrumental in modeling GPU architecture, baseboard components, and other features, working within a matrixed environment to document, design, develop tools for analysis and simulation, and validate models. The position involves familiarizing yourself with various functional and performance simulation models across NVIDIA, developing tests and testing infrastructure for new architectures, and guiding the improvement of the simulation platform to support future GPU architectures. You will also have the opportunity to develop or use AI to assist with daily tasks.

$152k - $288k

NVIDIA is seeking a Principal AI and ML Infra Software Engineer to join their Hardware Infrastructure team. This role is pivotal in enhancing researcher efficiency by implementing advancements across the entire technology stack. The engineer will collaborate closely with customers to identify and resolve infrastructure deficiencies, enabling groundbreaking AI and ML research on GPU Clusters. The goal is to build powerful, effective, and scalable solutions that shape the future of AI/ML technology.

$272k - $431k

We are hiring senior engineers to work on the CUDA driver, a core component of our platform for accelerating general purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, and self-driving cars to video games and virtual reality! CUDA defines a unified programming model across a range of system configurations and hardware capabilities. To accomplish this, the CUDA driver interacts with GPU hardware, kernel mode drivers, switches and the operating system. As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best Compute platform in the world. You will craft elegant solutions to exciting problems and craft the future direction of CUDA as you collaborate with your peers across NVIDIA.

$272k - $431k

NVIDIA is seeking an AI Hardware Architect to design and analyze the next generation of Artificial Intelligence hardware, focusing on building innovative AI chips and chiplets for the AI infrastructure market. This role involves understanding computer architecture, microarchitecture, and chip design, with opportunities for continuous learning and growth. You will work on groundbreaking GPU and CPU systems, identify areas for improvement, and study the architectural implications of AI applications and models running on NVIDIA hardware.

$184k - $357k

NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.

$152k - $288k

NVIDIA is seeking a motivated Performance Engineer to join our GPU Communications Libraries and Networking team. This role involves influencing the roadmap of communication libraries that are critical for Deep Learning and High Performance Computing applications running on massive GPU clusters. You will analyze and optimize communication performance between GPUs, which directly impacts end-to-end application performance at scale. This is an excellent opportunity to advance the state of the art in GPU communication and contribute to NVIDIA's innovative technologies.

$152k - $288k

NVIDIA is seeking a Senior Systems Software Engineer to focus on GPU Performance at Scale. In this role, you will drive innovation in AI and GPU computing by contributing to world-class computing hardware and software. You will provide insights into large-scale system composition and tuning for high-performance compute runs, collaborating with researchers, developers, and customers to create improved workflows and develop new solutions. You will also engage with HPC, OS, CPU, GPU compute, and systems specialists to architect, build, and optimize large-scale performance platforms.

$184k - $357k

Harvey is transforming legal and professional services by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise. This role is an opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team moves fast, takes ownership, and is deeply committed to the mission, operating with intensity and pushing for excellence. As a Member of Technical Staff, Infrastructure, you will build the systems that power how we adapt and improve leading open-weight models for legal work, focusing on scaling post-training efforts and owning the infrastructure behind distributed training, RL rollouts, agent environments, and internal tooling for data management, evals, and job tracking.

$230k - $340k

SpaceXAI is seeking an engineer to join our RL infrastructure team and help develop our evaluation infrastructure. This role involves building highly reliable, efficient, and user-friendly systems to run evaluations at scale. You will collaborate with modeling and evaluation teams to develop new evaluations, maintain signal quality, and create internal tooling for training next-generation models. A key part of this role is identifying and resolving performance bottlenecks across the entire evaluation infrastructure stack, including inference, capacity fleet management, and asynchronous evaluation orchestration.

$180k - $440k

Crusoe

Crusoe is seeking a Senior Production Engineer to join their team and ensure the reliability and scalability of their AI-optimized cloud platform. This role is crucial for building and operating managed AI services at scale, focusing on delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive workloads. The ideal candidate will have a strong background in distributed systems and hands-on experience with large language models, contributing to the future of AI infrastructure.

$170k - $205k

Lead performance optimization for large-scale AI workloads, transforming them into faster and more efficient systems. This role involves analyzing and optimizing AI training and inference across distributed systems, connecting compute, memory, and networking behavior. You will lead complex performance workstreams, identify bottlenecks, validate improvements, and translate performance data into actionable engineering decisions. The position requires building benchmarks, profiling demanding workloads, and developing C++ and Python tools for analysis and optimization, ultimately helping teams enhance efficiency, scalability, and reliability. This role offers broad technical scope across AI infrastructure at data center scale.

Salary not listed

SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.

$180k - $440k

Crusoe

Crusoe is seeking a highly skilled Software Engineer to join their Data Center Infrastructure Engineering team. This role focuses on developing software for managing a fleet of GPU servers and the data centers that house them. The position involves creating and implementing advanced diagnostic, observability, automation, and repair tooling for high-performance GPU compute clusters. The ideal candidate will be a hands-on problem solver comfortable working independently, playing a critical role in maintaining the health and scalability of Crusoe's rapidly growing GPU fleet.

$170k - $205k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping robots with human-level intelligence. These robots are engineered to perform a variety of tasks in home and commercial markets. We are seeking a Staff AI Inference & Acceleration Engineer to join our Platform Software team. This role will be responsible for the on-board inference architecture for our humanoid robots, acting as the technical authority on how AI workloads are mapped, optimized, and executed across the robot's compute hardware. The primary objective is to reduce power consumption and cost while meeting strict latency and reliability demands for a real-time autonomous system.

$180k - $275k

Anthropic

Our team builds the systems that enable every change to Anthropic's software to reach production safely and predictably. This includes managing pipelines, staged rollouts, health-gated promotion, rollback, runtime configuration, and feature flags across a large fleet of machines. You will own a significant part of this end-to-end process, from initial design to ongoing operation in production. If you are passionate about influencing the speed and safety of Anthropic's software releases, this role offers a unique opportunity.

$405k - $485k

SpaceXSI is building one of the world's largest AI supercomputers from the ground up. As part of the Compute Infrastructure team, you will own both the raw GPU supercomputer and the platform layer that runs on top of it. You will work across the full stack—from low-level GPU kernel optimizations and Linux kernel internals to massive-scale orchestration and virtualization—to make training and inference at SpaceXSI as fast, reliable, and scalable as possible. This is a broad, high-impact role that combines hardcore supercompute and compute infrastructure work. Your contributions will directly accelerate Grok's training speed and overall AI progress.

$180k - $440k

Perplexity AI

Perplexity is seeking a Member of Technical Staff to join their GPU Cluster Infrastructure team. This role will own the underlying GPU infrastructure that powers Perplexity's AI inference requests, which serve hundreds of millions of queries monthly. The goal is to abstract away the complexity of GPU provisioning, cluster configuration, and multi-cloud management into a unified, self-serve platform for both training and inference workloads. You will be responsible for the entire lifecycle of the GPU fleet, ensuring reliability, efficient capacity utilization, and seamless operation across different cloud providers.

$250k - $485k

NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.

$184k - $357k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping them with human-level intelligence for home and commercial markets. The Helix team is looking for an experienced Data Infrastructure Engineer to advance the AI data infrastructure. This role involves building tools and software components for robot data management, including offloading, storage, manipulation, and access, while managing on-premise and cloud resources and providing production support. The ideal candidate will have experience building tools and infrastructure for large-scale autonomous or deep learning systems.

$150k - $400k

NVIDIA DGX Cloud is seeking a Senior Software Engineer to join the Bare Metal Infrastructure team. This role focuses on building and maintaining the software that transforms new hardware into reliable, production-ready GPU capacity for demanding AI workloads. The ideal candidate will have deep systems engineering expertise, understanding the intricacies of servers, firmware, BMCs, and networks. You will be involved in the entire bare-metal lifecycle, from new platform introduction and firmware qualification to automated provisioning, validation, and remediation. The team heavily utilizes AI agents and LLM tools in its development process, and we are looking for someone eager to expand these capabilities.

$152k - $288k

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Mercor is seeking an AI Infrastructure Engineer to build and manage the GPU and accelerator platform that powers our AI workloads. This role involves overseeing clusters, schedulers, training and inference serving, and the observability and cost data associated with fleet usage. You will write production code daily and own systems end-to-end, from design to on-call responsibilities. Mercor is a leading AI data company, building the layer between human expertise and frontier models, with a mission to organize human intelligence to power the AI economy. We are a profitable Series C company valued at $10 billion.

$200k - $400k

Figma is seeking a hands-on engineering leader to manage and grow its AI Infrastructure team. This team builds the foundational inference systems that power Figma's AI products, ensuring reliability, observability, and seamless integration of cutting-edge models. The role involves defining and executing technical strategy, collaborating across engineering, and directly contributing to the core AI platform. This is an opportunity to join a rapidly growing team at the ground floor and shape the future of AI at Figma.

$258k - $376k