AI Infrastructure Engineer Jobs in San Francisco

Join NVIDIA’s Hyperscale Engineering team to develop networking solutions for large-scale AI infrastructure. You will work with customers and engineering teams to build, integrate, and improve software for BlueField and ConnectX platforms. Your work will span software development, system integration, troubleshooting, and performance analysis, helping customers move from initial testing to production deployment.

$184k - $357k

NVIDIA is seeking outstanding system architects to design the next generation GPU system interface. This position offers the opportunity to have a real impact in a dynamic, technology-focused company impacting the field of artificial intelligence and product lines ranging from consumer graphics to self-driving cars. We have crafted a team of extraordinary people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform of tomorrow.

$152k - $288k

Join NVIDIA's Modular Diagnostics team and lead AI-powered innovation. Our team develops key diagnostic applications and infrastructure to test every NVIDIA GPU, ensuring flawless performance before launch. As a Senior Software Engineer, AI Infrastructure Solutions, you will build intelligent automation to speed up critical engineering workflows and improve GPU validation speed and quality.

$152k - $242k

NVIDIA is seeking a Senior Software Engineering Manager to lead the development of a production-quality reinforcement learning (RL) ecosystem. This role involves building and extending RL post-training frameworks and the underlying systems that enable modern AI to reason, use tools, and act as agents. You will be responsible for setting strategy, building and managing a globally distributed team, and translating technical and customer signals into clear engineering priorities. The work spans various RL frameworks and their supporting systems, requiring deep systems expertise to ensure reliability and scalability across GPUs, CPUs, networking, and storage.

$272k - $431k

NVIDIA is seeking a Senior Software Engineer to advance the C++ foundation of CUDA Core Libraries. This role involves designing and optimizing high-performance algorithms and APIs for C++ developers, contributing to the foundational libraries, algorithms, and language/runtime infrastructure that power CUDA. You will be responsible for the full lifecycle of features, from design and implementation to testing, profiling, and maintenance, ensuring a speed-of-light experience for developers and AI coding agents.

$184k - $357k

NVIDIA is seeking software engineers to work on the CUDA driver for Windows. CUDA is NVIDIA's platform for accelerating general-purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, from deep learning and scientific computation to video games and virtual reality. As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best compute platform in the world. You will craft elegant solutions to exciting problems and shape the future direction of CUDA as you collaborate with your peers across NVIDIA.

$184k - $357k

NVIDIA is seeking outstanding senior engineers to work on the CUDA driver, a key component of accelerated GPU computing. You will join a versatile software engineering team that delivers innovative software features to unlock the full potential and performance of NVIDIA hardware across diverse workloads like deep learning, scientific research, autonomous vehicles, gaming, and virtual reality. This multi-functional role requires collaboration with hardware architects, deep learning specialists, and both internal and external partners to advance the CUDA architecture. With the opportunity to collaborate with teams across the whole NVIDIA computing stack, you will help design software solutions across kernel mode components, compilers, and networking software. Your system-level expertise and creativity in solving complex problems will help invent the future of CUDA and NVIDIA’s compute technologies! Does crafting solutions to influence the evolution of GPU-accelerated computing sound exciting? If so, we invite you to join us and help engineer the next wave of innovation at NVIDIA!

$152k - $288k

We are hiring software engineers to work on the CUDA driver, a core component of our platform for accelerating general-purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, and self-driving cars to video games and virtual reality. CUDA defines a unified programming model across a range of system configurations and hardware capabilities. To accomplish this, the CUDA driver interacts with GPU hardware, kernel mode drivers, and the operating system. Unified Memory kernel driver provides kernel memory management that enables these advanced features. As a member of our team, you will apply your design, coding expertise, and creativity, and to collaborate with peers across NVIDIA to deliver upon the best compute platform in the world. You will craft sophisticated solutions to exciting problems shaping the future direction of CUDA!

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to enhance the Python experience for its foundational CUDA Core Libraries. This role involves building Pythonic APIs, language bindings, algorithms, and runtime infrastructure that sit on top of native C/C++ foundations. You will contribute to the core libraries and infrastructure that make CUDA a high-performance platform for developers and AI coding agents. The position requires a strong focus on designing and implementing efficient, reliable, and scalable GPU-accelerated software, with an emphasis on improving the Python developer experience through robust tooling and clear documentation.

$184k - $357k

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced CUDA features and Distributed Runtime technologies into AI stacks, including frameworks like PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will join the team responsible for core CUDA features and runtimes that scale Deep Learning and HPC applications, addressing diverse multi-GPU demands from large-scale training to low-latency inference. Your work will enhance the productivity and performance of AI applications, accelerating community adoption through AI toolkits. This role offers a significant opportunity to advance the state of the art in AI technologies.

$184k - $357k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This role is integral to a team that delivers features and improvements to realize the full potential of NVIDIA hardware for a wide range of computational workloads, including deep learning, scientific computation, data science, self-driving cars, video games, and virtual reality. You will use your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA by collaborating with peers across NVIDIA.

$152k - $288k

NVIDIA's Architecture group is seeking a GPU System Performance Architect passionate about GPU-accelerated deep learning, data analytics, and high-performance computing. This role involves designing and developing the next generation of GPU-accelerated computing systems, offering a significant impact within a dynamic, technology-focused company. You will contribute to innovative processor and system architectures, analyze system performance trade-offs using analytical models and simulators, and understand hardware-software interactions in large-scale data center deployments. Collaboration across software, product, and business teams will be key to guiding the future of GPU-accelerated cloud computing.

$224k - $357k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This core platform component accelerates general-purpose computation on the GPU. You will be an integral part of a team delivering features and improvements to realize the full potential of NVIDIA hardware across diverse workloads, including deep learning, scientific computation, data science, self-driving cars, video games, and virtual reality. You will use your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA.

$272k - $431k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This core component of our platform accelerates general-purpose computation on the GPU. You will be an integral part of a team delivering features and improvements to realize the full potential of NVIDIA hardware across diverse workloads, including deep learning, scientific computation, data science, gaming, and virtual reality. You will leverage your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA.

$184k - $357k

NVIDIA is seeking a Principal SW Architect, Networking to build the future of AI data-centers. This role is tailored for those passionate about collective communication, vertical co-development of AI networks, and large model training scalability. Your work will drive innovation and contribute to large-scale production, making a real impact on the world. Join a team of forward-thinking and driven engineers, and contribute to a legacy of innovation.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to focus on AI Inference Performance, advancing innovative LLM and VLM inference on NVIDIA GPU-accelerated systems. This hands-on role involves pushing workloads to practical performance limits, delivering measurable gains in latency, throughput, efficiency, and scale. You will translate performance models and profiler data into working code, collaborating with various teams and contributing improvements to open-source inference engines. Your work will directly impact production deployments and help shape future NVIDIA platforms.

$184k - $357k

Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools for optimizing efficiency and resiliency of AI workloads, including pre-training, post-training, and inference. Our objective is to deliver a stable, scalable environment for AI researchers, providing them with the necessary resources and scale to foster innovation. As a senior DGX Cloud AI Infrastructure software engineer, you will have the opportunity to work on innovative technologies that power the future of AI and data science and be part of a dynamic, diverse, and supportive team that values learning and growth.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.

$184k - $357k

NVIDIA is seeking a Senior AI Compute Engineer to join its Infrastructure Specialists team. This role involves working with academic, commercial, and government groups globally to revolutionize deep learning and data analytics, and to power data centers. You will be part of a team building some of the world's largest and fastest AI Compute systems. The position requires strong interpersonal skills to interact with customers, partners, and internal teams to analyze, define, and implement large-scale AI Compute projects, encompassing networking, system design, automation, and validation.

$148k - $288k

We are seeking software engineers to develop next-generation high-speed interconnect technologies for GPU and high-performance computing servers. This role involves close collaboration with hardware architects, silicon designers, and platform software experts to drive innovation in factories and data centers. The ideal candidate will possess strong C++ programming skills, a deep understanding of networking concepts, systems software fundamentals, and current hardware architecture. Excellent communication and meticulous engineering practices are essential for providing robust and efficient solutions to validate and test next-generation processors.

$184k - $357k

NVIDIA is seeking an AI Compute Engineer to join its Infrastructure Specialists team. This role involves working on some of the world's largest and fastest AI Compute systems, supporting academic, commercial, and government groups. The engineer will interact with customers, partners, and internal teams to analyze, define, and implement large-scale AI Compute projects, encompassing networking, system design, automation, and validation.

$124k - $196k

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

NVIDIA is seeking a Distinguished Engineer to lead the company's storage strategy for AI Cloud, focusing on the Neocloud Provider (NCP) and Cloud Service Provider (CSP) ecosystem. This role involves directing the architecture of high-performance parallel file systems, object stores, and block storage at exabyte scale. You will remain hands-on, collaborating with engineers, SREs, partners, and storage vendors, and leveraging NVIDIA's AI tools to enhance productivity. This is a unique opportunity to shape the storage framework for the AI era at a company that pioneered accelerated computing, ensuring that storage platforms can keep tens of thousands of accelerators continuously busy and power the largest AI workloads worldwide.

Salary not listed

NVIDIA is seeking a Senior Software Architect to join our GPU Communications Libraries and Networking team. This role involves co-designing next-generation data center platforms and scalable communication software crucial for advancing Deep Learning and High Performance Computing (HPC). You will investigate and identify communication performance bottlenecks, design and implement new communication technologies, and explore innovative hardware and software solutions for future platforms. This is an opportunity to break performance barriers and deliver cutting-edge technologies that power AI and HPC workloads at massive scales.

$184k - $357k