AI Infrastructure Engineer Jobs

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments. Built in Rust for performance and Python for extensibility, Dynamo orchestrates GPU shards, routes requests, and manages shared KV cache across heterogeneous clusters so that many accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the memory and compute budget of any single GPU, this platform enables efficient, resilient deployment of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and roadmap for memory management of large-scale LLM and storage systems.

$272k - $431k

NVIDIA's Managed AI Research Superclusters (MARS) team is seeking a Senior GPU Supercomputer Scheduler Engineer to design and implement groundbreaking GPU compute clusters. This role involves developing solutions for demanding deep learning, high-performance computing, and computationally intensive workloads. You will contribute to the design and implementation of new scheduling features and services to optimize GPU compute clusters for fairness, occupancy, resilience, performance, and power usage. This is an excellent opportunity to deliver production-grade solutions, work with cutting-edge technology, and collaborate with technical leaders on significant challenges in machine learning, cloud computing, and system co-design.

$152k - $288k

NVIDIA is seeking an AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves developing and optimizing the compiler that powers NVIDIA's inference engine across various platforms, from data centers to personal devices. The compiler is crucial for delivering leading inference performance, fast build times, reduced memory footprints, and ease of use for the global deep learning community. You will contribute to the next era of computing by enabling breakthroughs in areas like large language models and generative AI.

$152k - $242k

NVIDIA is seeking an AI Storage Platform Architect to bridge the gap between advanced hardware and AI deployments. This role involves translating the capabilities of NVIDIA's latest hardware, including Rubin GPUs, Vera CPUs, BlueField DPUs, NVLink, and Spectrum-X networking, into production-ready blueprints. You will collaborate with storage ecosystem partners to co-develop reference architectures for the NVIDIA AI Data Platform, optimizing every layer of the stack for AI workloads. This is an opportunity to work in a diverse and supportive environment, making a significant impact on the future of computing.

$224k - $357k

We are seeking a software engineer with a strong background in parallel processing and GPU architecture to advance performance at the intersection of AI, high-performance computing, and financial markets. This role involves in-depth work with parallel algorithms, GPUs, and complex systems to identify and resolve bottlenecks, maximizing the capabilities of advanced processing hardware. You will collaborate with leading experts, influence future platforms, and share your findings with the global developer community. If you excel at solving challenging technical problems, enjoy performance tuning, and want your work to significantly impact an industry, we encourage you to apply.

$152k - $288k

NVIDIA is seeking a Principal Deep Learning Communication Architect to define the long-term technical roadmap for communication libraries across next-generation platforms, ensuring seamless scaling of models to massive clusters. This role involves leading the development of advanced communication primitives and collective algorithms, optimizing for heterogeneous interconnects, and co-designing libraries with application developers to meet the demands of trillion-parameter and Agentic AI. The architect will also collaborate with silicon architects to influence hardware specifications for future networking needs and develop analytical models to predict system behavior under emerging workloads.

$272k - $431k

An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to optimize data movement between GPUs, nodes, and storage at the speed required for modern AI, focusing on low-level transport, hardware-software co-design, and communication frameworks integrated into AI stacks. Their work also extends to emerging areas like quantum computing interconnects. This Principal Architect role will define the research agenda and architectural direction for NVIDIA's large-scale AI systems communication, encompassing GPUs, DPUs, NICs, and heterogeneous storage. The position demands the ability to define project scope, conduct original research, publish findings, and translate breakthroughs into production-ready software for industry-wide deployment.

$272k - $431k

NVIDIA is seeking a Software Engineering Manager for its applied research team within the Networking Systems & Software Architecture group. This role will focus on solving complex AI infrastructure challenges by building systems-level software that efficiently moves data between GPUs, nodes, and storage at the speed required for modern AI. The team's work spans low-level transport optimization, hardware-software co-design, and communication frameworks integrated into production AI stacks, with an expansion into emerging areas like quantum computing interconnects. The Engineering Manager will lead this team, driving execution and setting technical direction, while fostering an extraordinary engineering organization.

$184k - $357k

NVIDIA is seeking a GPU System Architect to design multi-GPU scale-up and scale-out systems for next-generation AI and HPC datacenter platforms. This role involves defining system architectures that integrate GPU compute, high-bandwidth memory, and interconnects to achieve industry-leading AI performance, scalability, and resilience. The ideal candidate will possess extensive experience in system-level fabric/networking architecture and hardware-software co-design.

$184k - $357k

NVIDIA is seeking a Senior System Software Engineer to join its GPU-accelerated deep learning software team, focusing on the Dynamo platform. This role involves developing open-source software for efficient Generative AI inference on GPUs, making AI model design and deployment more accessible. The team is building a fast-paced inference platform to support the growing AI revolution, enabling breakthroughs across various domains like image classification, speech recognition, and natural language processing.

$224k - $431k

Our LLM Inference Performance Analysis and Optimization team is seeking a Senior Inference Engineer specializing in GPU Kernel Optimization. This role is crucial for maximizing the performance of LLM inference operations by developing advanced infrastructure and tooling. You will build silicon-measured kernel benchmarking systems, model-level performance projection tools, and agentic optimization systems that enhance GPU kernels at the assembly layer. The position involves close collaboration with compiler, kernel, hardware, and framework teams across NVIDIA to identify and address performance bottlenecks, driving measurable improvements in LLM inference.

$184k - $288k

We are seeking a Senior Software Engineer to drive the integration of the NVIDIA Grove project within Dynamo and across a set of leading open-source AI frameworks. In this role, you will develop production-grade software enabling Grove capabilities to be adopted, scaled, and operated smoothly across environments such as Dynamo, llm-d, Ray, PyTorch, and other emerging frameworks in the AI ecosystem. You will collaborate across engineering teams and the open-source community to deliver robust integrations, reference implementations, and developer-focused tooling.

$152k - $288k

An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to facilitate high-speed data transfer between GPUs, nodes, and storage, crucial for modern AI demands. This involves optimizing low-level transport, co-designing hardware and software, and creating communication frameworks that integrate with production AI stacks. The team's scope also extends to emerging areas like quantum computing interconnects. The Senior Architect will lead modules and projects from initial research scoping through to production code delivery, acting as a recognized expert to guide technical decisions, incorporate external ideas, and prototype novel solutions.

$224k - $431k

NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.

$124k - $242k

NVIDIA is seeking an engineering lead to architect and scale the data acquisition infrastructure that powers our foundation models. This hands-on technical leadership role spans distributed systems, crawl infrastructure, and third-party data ingestion, focusing on building systems that discover valuable sources, crawl the open web at scale, and deliver reliable, high-quality data to training pipelines. You will own the architecture of a unified platform covering source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion, with the goal of bringing existing infrastructure to pretraining scale and extending it to additional model families, modalities, and acquisition workflows. You will also lead architecture reviews, critical implementation work, mentor engineers, and help build the team.

$272k - $431k

NVIDIA is seeking outstanding system architects to design the next generation GPU system interface. This position offers the opportunity to have a real impact in a dynamic, technology-focused company impacting the field of artificial intelligence and product lines ranging from consumer graphics to self-driving cars. We have crafted a team of extraordinary people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform of tomorrow.

$152k - $288k

Join NVIDIA's Modular Diagnostics team and lead AI-powered innovation. Our team develops key diagnostic applications and infrastructure to test every NVIDIA GPU, ensuring flawless performance before launch. As a Senior Software Engineer, AI Infrastructure Solutions, you will build intelligent automation to speed up critical engineering workflows and improve GPU validation speed and quality.

$152k - $242k

NVIDIA Nsight Compute develops groundbreaking performance tools for GPUs, catering to both newcomers and expert CUDA developers. Join our team to craft the future of profiling tools, helping engineers harness the full power of GPU technology for AI and High Performance Computing breakthroughs. You will design and implement innovative features for our GPU performance profiling tools with a focus on AI applications, build tools instantly used by CUDA developers worldwide, and collaborate with internal teams like the compiler and CUDA driver teams to influence and design new features from the bottom up.

$152k - $288k

NVIDIA is seeking a Senior Performance Compiler Engineer to join their open-source Triton compiler project. This role focuses on improving AI performance on NVIDIA GPUs by leveraging compiler technology. You will work on cutting-edge AI applications, including large language models and agents, accelerating both training and inference. The position offers a collaborative and supportive environment to push the boundaries of AI computing.

$184k - $288k

NVIDIA is seeking a Senior Software Engineering Manager to lead the development of a production-quality reinforcement learning (RL) ecosystem. This role involves building and extending RL post-training frameworks and the underlying systems that enable modern AI to reason, use tools, and act as agents. You will be responsible for setting strategy, building and managing a globally distributed team, and translating technical and customer signals into clear engineering priorities. The work spans various RL frameworks and their supporting systems, requiring deep systems expertise to ensure reliability and scalability across GPUs, CPUs, networking, and storage.

$272k - $431k

NVIDIA is seeking a Senior Software Engineer to advance the C++ foundation of CUDA Core Libraries. This role involves designing and optimizing high-performance algorithms and APIs for C++ developers, contributing to the foundational libraries, algorithms, and language/runtime infrastructure that power CUDA. You will be responsible for the full lifecycle of features, from design and implementation to testing, profiling, and maintenance, ensuring a speed-of-light experience for developers and AI coding agents.

$184k - $357k

NVIDIA is seeking software engineers to work on the CUDA driver for Windows. CUDA is NVIDIA's platform for accelerating general-purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, from deep learning and scientific computation to video games and virtual reality. As a member of our team, you will use your design abilities, coding expertise, and creativity to deliver the best compute platform in the world. You will craft elegant solutions to exciting problems and shape the future direction of CUDA as you collaborate with your peers across NVIDIA.

$184k - $357k

NVIDIA is seeking outstanding senior engineers to work on the CUDA driver, a key component of accelerated GPU computing. You will join a versatile software engineering team that delivers innovative software features to unlock the full potential and performance of NVIDIA hardware across diverse workloads like deep learning, scientific research, autonomous vehicles, gaming, and virtual reality. This multi-functional role requires collaboration with hardware architects, deep learning specialists, and both internal and external partners to advance the CUDA architecture. With the opportunity to collaborate with teams across the whole NVIDIA computing stack, you will help design software solutions across kernel mode components, compilers, and networking software. Your system-level expertise and creativity in solving complex problems will help invent the future of CUDA and NVIDIA’s compute technologies! Does crafting solutions to influence the evolution of GPU-accelerated computing sound exciting? If so, we invite you to join us and help engineer the next wave of innovation at NVIDIA!

$152k - $288k

We are hiring software engineers to work on the CUDA driver, a core component of our platform for accelerating general-purpose computation on the GPU. Our team delivers features and improvements to better realize the potential of NVIDIA hardware for a growing range of computational workloads, ranging from deep learning, scientific computation, and self-driving cars to video games and virtual reality. CUDA defines a unified programming model across a range of system configurations and hardware capabilities. To accomplish this, the CUDA driver interacts with GPU hardware, kernel mode drivers, and the operating system. Unified Memory kernel driver provides kernel memory management that enables these advanced features. As a member of our team, you will apply your design, coding expertise, and creativity, and to collaborate with peers across NVIDIA to deliver upon the best compute platform in the world. You will craft sophisticated solutions to exciting problems shaping the future direction of CUDA!

$184k - $357k