AI Infrastructure Engineer Jobs in San Francisco

Perplexity AI

Perplexity is seeking software engineers to join our Training Infrastructure team. This team is responsible for large-scale RL and agent evaluation platforms that enable the company to train state-of-the-art models and optimize agent harnesses. As a full-stack engineer on this team, you will build distributed systems that orchestrate AI workloads across global-scale compute infrastructure, define novel user and agent interfaces for designing, managing, and launching experiments, and create tools that make experiment results legible to humans and agents alike. A strong candidate will possess both experience and passion for solving difficult problems at the intersection of AI, distributed systems, and research acceleration.

$220k - $405k

CoreWeave

CoreWeave is seeking a Junior Software Engineer to join their Inference team. In this role, you will be responsible for the end-to-end ownership of a production service, including feature development, maintenance of dashboards and alarms, and operational improvements. You will collaborate with cross-functional teams to enhance key service level indicators and contribute to the development of a cutting-edge inference platform that powers generative AI and real-time applications at scale.

$120k - $160k

Join NVIDIA's ambitious team and be part of a legacy of innovation! We are seeking a Principal SW Architect, Networking to build the future of AI data-centers. This role is tailored for those passionate about collective communication, vertical co-development of AI networks, and large model training scalability. Your work will drive innovation and contribute to large-scale production, making a real impact on the world!

$272k - $431k

CoreWeave

CoreWeave is seeking a Staff Software Engineer to join the Inference Platform Team. This team builds and operates CoreWeave’s Kubernetes-native inference platform, designed for low-latency, high-throughput AI workloads at massive scale. As a technical leader, you will drive architecture, performance, and reliability across multiple services and teams. Your responsibilities will include optimizing inference performance (latency, throughput, and GPU utilization), improving system reliability, and working deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization. This role requires hands-on technical leadership and the ability to influence engineering direction across the organization.

$188k - $275k

NVIDIA is seeking a visionary Product Architect with strong expertise in systems architecture to join our AI Infrastructure and Agentic AI team. You will design and shape the architectures that connect the world's most powerful AI clusters, transforming ideas into well-defined, functional products by balancing technical feasibility with user needs and market demands. This role is at the nexus of designing and overseeing cutting-edge AI solutions from conception through their entire lifecycle, focusing on efficiency and multiplying efforts.

$184k - $357k

CoreWeave

CoreWeave is seeking a Senior Engineer to join its Benchmarking & Performance team. This role will focus on building performance insights and observability systems for AI infrastructure, covering everything from individual GPUs and interconnects to distributed training and inference workloads. You will be responsible for detecting, diagnosing, and surfacing performance signals across global data centers, transforming raw telemetry into actionable insights for engineers, product teams, and executives. This is a hands-on role focused on building observability tooling that provides near real-time answers about infrastructure performance, rather than a traditional data engineering or BI position.

$182k - $242k

NVIDIA is seeking an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. This role focuses on building supercomputers and AI clusters using cutting-edge technologies. You will be instrumental in contributing to breakthroughs in artificial intelligence and GPU computing by providing insights on large-scale system design and tuning. You will collaborate with researchers, developers, and customers, working with the latest accelerated computing and deep learning platforms to craft improved workflows and develop innovative solutions. The position involves interacting with specialists in HPC, OS, GPU compute, and systems to architect, develop, and deploy large-scale performance platforms.

$176k - $334k

NVIDIA is seeking a senior or principal engineer to build cutting-edge infrastructure for large-scale foundation model training within the Generalist Embodied Agent Research (GEAR) group. This team is spearheading Project GR00T, an initiative focused on developing foundation models and full-stack technology for humanoid robots. You will collaborate with a research team known for influential work in multimodal foundation models, large-scale robot learning, embodied AI, and physics simulation, contributing to impactful research projects and product roadmaps.

$224k - $357k

We are seeking software engineers to work on next-generation graphics and computing products. Our charter is to develop the most demanding applications a GPU or high-performance computing server will encounter in its lifecycle, by collaborating closely with customers to support innovation in their factories and data centers. As a system software engineer, you will extensively use your knowledge of operating systems, algorithms, and computer architecture to provide robust and efficient solutions to validate and test next generation processors.

$184k - $357k

NVIDIA's GPU Architecture group is seeking world-class architects and software developers to lead architecture efforts. The role focuses on innovating in graphics and parallel computing to deliver the highest performance for deep learning and parallel processing algorithms. You will be responsible for developing and enhancing GPU architecture features, advancing parallel programming models, and designing new architectures to maintain leadership in AI computing. This involves interacting with other architects and researchers to build simulators, map deep learning workloads to hardware, and validate new architectural features.

$184k - $357k

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments. Built in Rust for performance and Python for extensibility, Dynamo orchestrates GPU shards, routes requests, and manages shared KV cache across heterogeneous clusters so that many accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the memory and compute budget of any single GPU, this platform enables efficient, resilient deployment of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and roadmap for memory management of large-scale LLM and storage systems.

$272k - $431k

NVIDIA's Managed AI Research Superclusters (MARS) team is seeking a Senior GPU Supercomputer Scheduler Engineer to design and implement groundbreaking GPU compute clusters. This role involves developing solutions for demanding deep learning, high-performance computing, and computationally intensive workloads. You will contribute to the design and implementation of new scheduling features and services to optimize GPU compute clusters for fairness, occupancy, resilience, performance, and power usage. This is an excellent opportunity to deliver production-grade solutions, work with cutting-edge technology, and collaborate with technical leaders on significant challenges in machine learning, cloud computing, and system co-design.

$152k - $288k

NVIDIA is seeking an AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves developing and optimizing the compiler that powers NVIDIA's inference engine across various platforms, from data centers to personal devices. The compiler is crucial for delivering leading inference performance, fast build times, reduced memory footprints, and ease of use for the global deep learning community. You will contribute to the next era of computing by enabling breakthroughs in areas like large language models and generative AI.

$152k - $242k

NVIDIA is seeking an AI Storage Platform Architect to bridge the gap between advanced hardware and AI deployments. This role involves translating the capabilities of NVIDIA's latest hardware, including Rubin GPUs, Vera CPUs, BlueField DPUs, NVLink, and Spectrum-X networking, into production-ready blueprints. You will collaborate with storage ecosystem partners to co-develop reference architectures for the NVIDIA AI Data Platform, optimizing every layer of the stack for AI workloads. This is an opportunity to work in a diverse and supportive environment, making a significant impact on the future of computing.

$224k - $357k

We are seeking a software engineer with a strong background in parallel processing and GPU architecture to advance performance at the intersection of AI, high-performance computing, and financial markets. This role involves in-depth work with parallel algorithms, GPUs, and complex systems to identify and resolve bottlenecks, maximizing the capabilities of advanced processing hardware. You will collaborate with leading experts, influence future platforms, and share your findings with the global developer community. If you excel at solving challenging technical problems, enjoy performance tuning, and want your work to significantly impact an industry, we encourage you to apply.

$152k - $288k

NVIDIA is seeking a Principal Deep Learning Communication Architect to define the long-term technical roadmap for communication libraries across next-generation platforms, ensuring seamless scaling of models to massive clusters. This role involves leading the development of advanced communication primitives and collective algorithms, optimizing for heterogeneous interconnects, and co-designing libraries with application developers to meet the demands of trillion-parameter and Agentic AI. The architect will also collaborate with silicon architects to influence hardware specifications for future networking needs and develop analytical models to predict system behavior under emerging workloads.

$272k - $431k

An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to optimize data movement between GPUs, nodes, and storage at the speed required for modern AI, focusing on low-level transport, hardware-software co-design, and communication frameworks integrated into AI stacks. Their work also extends to emerging areas like quantum computing interconnects. This Principal Architect role will define the research agenda and architectural direction for NVIDIA's large-scale AI systems communication, encompassing GPUs, DPUs, NICs, and heterogeneous storage. The position demands the ability to define project scope, conduct original research, publish findings, and translate breakthroughs into production-ready software for industry-wide deployment.

$272k - $431k

NVIDIA is seeking a Software Engineering Manager for its applied research team within the Networking Systems & Software Architecture group. This role will focus on solving complex AI infrastructure challenges by building systems-level software that efficiently moves data between GPUs, nodes, and storage at the speed required for modern AI. The team's work spans low-level transport optimization, hardware-software co-design, and communication frameworks integrated into production AI stacks, with an expansion into emerging areas like quantum computing interconnects. The Engineering Manager will lead this team, driving execution and setting technical direction, while fostering an extraordinary engineering organization.

$184k - $357k

NVIDIA is seeking a GPU System Architect to design multi-GPU scale-up and scale-out systems for next-generation AI and HPC datacenter platforms. This role involves defining system architectures that integrate GPU compute, high-bandwidth memory, and interconnects to achieve industry-leading AI performance, scalability, and resilience. The ideal candidate will possess extensive experience in system-level fabric/networking architecture and hardware-software co-design.

$184k - $357k

NVIDIA is seeking a Senior System Software Engineer to join its GPU-accelerated deep learning software team, focusing on the Dynamo platform. This role involves developing open-source software for efficient Generative AI inference on GPUs, making AI model design and deployment more accessible. The team is building a fast-paced inference platform to support the growing AI revolution, enabling breakthroughs across various domains like image classification, speech recognition, and natural language processing.

$224k - $431k

Our LLM Inference Performance Analysis and Optimization team is seeking a Senior Inference Engineer specializing in GPU Kernel Optimization. This role is crucial for maximizing the performance of LLM inference operations by developing advanced infrastructure and tooling. You will build silicon-measured kernel benchmarking systems, model-level performance projection tools, and agentic optimization systems that enhance GPU kernels at the assembly layer. The position involves close collaboration with compiler, kernel, hardware, and framework teams across NVIDIA to identify and address performance bottlenecks, driving measurable improvements in LLM inference.

$184k - $288k

We are seeking a Senior Software Engineer to drive the integration of the NVIDIA Grove project within Dynamo and across a set of leading open-source AI frameworks. In this role, you will develop production-grade software enabling Grove capabilities to be adopted, scaled, and operated smoothly across environments such as Dynamo, llm-d, Ray, PyTorch, and other emerging frameworks in the AI ecosystem. You will collaborate across engineering teams and the open-source community to deliver robust integrations, reference implementations, and developer-focused tooling.

$152k - $288k

An applied research team within NVIDIA's Networking Systems & Software Architecture group is tackling complex AI infrastructure challenges. The team develops systems-level software to facilitate high-speed data transfer between GPUs, nodes, and storage, crucial for modern AI demands. This involves optimizing low-level transport, co-designing hardware and software, and creating communication frameworks that integrate with production AI stacks. The team's scope also extends to emerging areas like quantum computing interconnects. The Senior Architect will lead modules and projects from initial research scoping through to production code delivery, acting as a recognized expert to guide technical decisions, incorporate external ideas, and prototype novel solutions.

$224k - $431k

NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.

$124k - $242k