Senior AI Infrastructure Engineer Jobs

NVIDIA is seeking a Senior Software Engineer to enhance the Python experience for its foundational CUDA Core Libraries. This role involves building Pythonic APIs, language bindings, algorithms, and runtime infrastructure that sit on top of native C/C++ foundations. You will contribute to the core libraries and infrastructure that make CUDA a high-performance platform for developers and AI coding agents. The position requires a strong focus on designing and implementing efficient, reliable, and scalable GPU-accelerated software, with an emphasis on improving the Python developer experience through robust tooling and clear documentation.

$184k - $357k

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced CUDA features and Distributed Runtime technologies into AI stacks, including frameworks like PyTorch, TRT-LLM, vLLM, SGLang, and JAX. You will join the team responsible for core CUDA features and runtimes that scale Deep Learning and HPC applications, addressing diverse multi-GPU demands from large-scale training to low-latency inference. Your work will enhance the productivity and performance of AI applications, accelerating community adoption through AI toolkits. This role offers a significant opportunity to advance the state of the art in AI technologies.

$184k - $357k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This role is integral to a team that delivers features and improvements to realize the full potential of NVIDIA hardware for a wide range of computational workloads, including deep learning, scientific computation, data science, self-driving cars, video games, and virtual reality. You will use your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA by collaborating with peers across NVIDIA.

$152k - $288k

NVIDIA is seeking a Deep Learning Software Infrastructure Engineer to advance its Autonomous Vehicles project. In this role, you will be responsible for building and scaling the training libraries and infrastructure necessary for end-to-end autonomous driving models. By enabling training on thousands of GPUs and massive datasets, you will significantly accelerate iteration speed and enhance safety, working collaboratively with research and platform teams across NVIDIA.

$224k - $431k

NVIDIA's Architecture group is seeking a GPU System Performance Architect passionate about GPU-accelerated deep learning, data analytics, and high-performance computing. This role involves designing and developing the next generation of GPU-accelerated computing systems, offering a significant impact within a dynamic, technology-focused company. You will contribute to innovative processor and system architectures, analyze system performance trade-offs using analytical models and simulators, and understand hardware-software interactions in large-scale data center deployments. Collaboration across software, product, and business teams will be key to guiding the future of GPU-accelerated cloud computing.

$224k - $357k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This core platform component accelerates general-purpose computation on the GPU. You will be an integral part of a team delivering features and improvements to realize the full potential of NVIDIA hardware across diverse workloads, including deep learning, scientific computation, data science, self-driving cars, video games, and virtual reality. You will use your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA.

$272k - $431k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This core component of our platform accelerates general-purpose computation on the GPU. You will be an integral part of a team delivering features and improvements to realize the full potential of NVIDIA hardware across diverse workloads, including deep learning, scientific computation, data science, gaming, and virtual reality. You will leverage your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA.

$184k - $357k

NVIDIA is seeking a Principal SW Architect, Networking to build the future of AI data-centers. This role is tailored for those passionate about collective communication, vertical co-development of AI networks, and large model training scalability. Your work will drive innovation and contribute to large-scale production, making a real impact on the world. Join a team of forward-thinking and driven engineers, and contribute to a legacy of innovation.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to focus on AI Inference Performance, advancing innovative LLM and VLM inference on NVIDIA GPU-accelerated systems. This hands-on role involves pushing workloads to practical performance limits, delivering measurable gains in latency, throughput, efficiency, and scale. You will translate performance models and profiler data into working code, collaborating with various teams and contributing improvements to open-source inference engines. Your work will directly impact production deployments and help shape future NVIDIA platforms.

$184k - $357k

Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools for optimizing efficiency and resiliency of AI workloads, including pre-training, post-training, and inference. Our objective is to deliver a stable, scalable environment for AI researchers, providing them with the necessary resources and scale to foster innovation. As a senior DGX Cloud AI Infrastructure software engineer, you will have the opportunity to work on innovative technologies that power the future of AI and data science and be part of a dynamic, diverse, and supportive team that values learning and growth.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.

$184k - $357k

NVIDIA is seeking a Senior AI Compute Engineer to join its Infrastructure Specialists team. This role involves working with academic, commercial, and government groups globally to revolutionize deep learning and data analytics, and to power data centers. You will be part of a team building some of the world's largest and fastest AI Compute systems. The position requires strong interpersonal skills to interact with customers, partners, and internal teams to analyze, define, and implement large-scale AI Compute projects, encompassing networking, system design, automation, and validation.

$148k - $288k

We are seeking software engineers to develop next-generation high-speed interconnect technologies for GPU and high-performance computing servers. This role involves close collaboration with hardware architects, silicon designers, and platform software experts to drive innovation in factories and data centers. The ideal candidate will possess strong C++ programming skills, a deep understanding of networking concepts, systems software fundamentals, and current hardware architecture. Excellent communication and meticulous engineering practices are essential for providing robust and efficient solutions to validate and test next-generation processors.

$184k - $357k

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

NVIDIA is seeking a Distinguished Engineer to lead the company's storage strategy for AI Cloud, focusing on the Neocloud Provider (NCP) and Cloud Service Provider (CSP) ecosystem. This role involves directing the architecture of high-performance parallel file systems, object stores, and block storage at exabyte scale. You will remain hands-on, collaborating with engineers, SREs, partners, and storage vendors, and leveraging NVIDIA's AI tools to enhance productivity. This is a unique opportunity to shape the storage framework for the AI era at a company that pioneered accelerated computing, ensuring that storage platforms can keep tens of thousands of accelerators continuously busy and power the largest AI workloads worldwide.

Salary not listed

NVIDIA is seeking a Senior Software Architect to join our GPU Communications Libraries and Networking team. This role involves co-designing next-generation data center platforms and scalable communication software crucial for advancing Deep Learning and High Performance Computing (HPC). You will investigate and identify communication performance bottlenecks, design and implement new communication technologies, and explore innovative hardware and software solutions for future platforms. This is an opportunity to break performance barriers and deliver cutting-edge technologies that power AI and HPC workloads at massive scales.

$184k - $357k

NVIDIA is seeking Architects, Functional Modeling Engineers, and Simulation experts to join its Architecture Modeling group. In this role, you will collaborate with world-class architects to enable functional simulation platforms across GPU generations. You will be instrumental in modeling GPU architecture, baseboard components, and other features, working within a matrixed environment to document, design, develop tools for analysis and simulation, and validate models. The position involves familiarizing yourself with various functional and performance simulation models across NVIDIA, developing tests and testing infrastructure for new architectures, and guiding the improvement of the simulation platform to support future GPU architectures. You will also have the opportunity to develop or use AI to assist with daily tasks.

$152k - $288k

NVIDIA is seeking a Principal AI and ML Infra Software Engineer to join their Hardware Infrastructure team. This role is pivotal in enhancing researcher efficiency by implementing advancements across the entire technology stack. The engineer will collaborate closely with customers to identify and resolve infrastructure deficiencies, enabling groundbreaking AI and ML research on GPU Clusters. The goal is to build powerful, effective, and scalable solutions that shape the future of AI/ML technology.

$272k - $431k

AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical task. This role is ideal for engineers who thrive at the intersection of product, infrastructure, and software engineering and who want to build automated, intelligence-driven systems that protect NVIDIA’s most critical AI platforms.

$184k - $357k

We are hiring senior engineers to work on the CUDA driver, a core component of our platform for accelerating general purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, and self-driving cars to video games and virtual reality! CUDA defines a unified programming model across a range of system configurations and hardware capabilities. To accomplish this, the CUDA driver interacts with GPU hardware, kernel mode drivers, switches and the operating system. As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best Compute platform in the world. You will craft elegant solutions to exciting problems and craft the future direction of CUDA as you collaborate with your peers across NVIDIA.

$272k - $431k

NVIDIA is seeking an AI Hardware Architect to design and analyze the next generation of Artificial Intelligence hardware, focusing on building innovative AI chips and chiplets for the AI infrastructure market. This role involves understanding computer architecture, microarchitecture, and chip design, with opportunities for continuous learning and growth. You will work on groundbreaking GPU and CPU systems, identify areas for improvement, and study the architectural implications of AI applications and models running on NVIDIA hardware.

$184k - $357k

NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.

$152k - $288k

NVIDIA is seeking a motivated Performance Engineer to join our GPU Communications Libraries and Networking team. This role involves influencing the roadmap of communication libraries that are critical for Deep Learning and High Performance Computing applications running on massive GPU clusters. You will analyze and optimize communication performance between GPUs, which directly impacts end-to-end application performance at scale. This is an excellent opportunity to advance the state of the art in GPU communication and contribute to NVIDIA's innovative technologies.

$152k - $288k

NVIDIA is seeking a Senior Systems Software Engineer to focus on GPU Performance at Scale. In this role, you will drive innovation in AI and GPU computing by contributing to world-class computing hardware and software. You will provide insights into large-scale system composition and tuning for high-performance compute runs, collaborating with researchers, developers, and customers to create improved workflows and develop new solutions. You will also engage with HPC, OS, CPU, GPU compute, and systems specialists to architect, build, and optimize large-scale performance platforms.

$184k - $357k