GPU Jobs

Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. We bring the innovation of 21st-century companies to the defense industry, redesigning how military systems are developed and sold. Our systems are powered by Lattice OS, an AI operating system that provides real-time command and control. As the world faces strategic competition, Anduril is dedicated to delivering cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology rapidly.

$167k - $222k

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Mercor is seeking an AI Infrastructure Engineer to build and manage the GPU and accelerator platform that powers our AI workloads. This role involves overseeing clusters, schedulers, training and inference serving, and the observability and cost data associated with fleet usage. You will write production code daily and own systems end-to-end, from design to on-call responsibilities. Mercor is a leading AI data company, building the layer between human expertise and frontier models, with a mission to organize human intelligence to power the AI economy. We are a profitable Series C company valued at $10 billion.

$200k - $400k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

SambaNova is seeking a new grad Compiler Engineer to work on core areas of our compiler, which powers the RDU (Reconfigurable Dataflow Unit) chip. This role involves working on the compiler's IR and pass infrastructure, model lowering and partitioning, tensor tiling, memory management, and mapping operations onto the accelerator fabric. You will gain insight into how compiler decisions impact chip performance, write production code in C++ and Python, perform low-level debugging, and collaborate with runtime and hardware teams. Senior engineers will provide code reviews and mentorship.

$131k - $197k

SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.

$180k - $440k

NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.

$124k - $242k

NVIDIA Research is seeking a PhD researcher to conduct groundbreaking research at the intersection of AI, GPU computing, and Electronic Design Automation (EDA). This role offers the opportunity to shape the future of chip design, which is being transformed by deep learning and GPU acceleration. We are looking for creative and collaborative individuals interested in tackling new challenges and contributing to a world-class technology employer.

$168k - $265k

NVIDIA is seeking a Senior Software Engineer to focus on AI Inference Performance, advancing innovative LLM and VLM inference on NVIDIA GPU-accelerated systems. This hands-on role involves pushing workloads to practical performance limits, delivering measurable gains in latency, throughput, efficiency, and scale. You will translate performance models and profiler data into working code, collaborating with various teams and contributing improvements to open-source inference engines. Your work will directly impact production deployments and help shape future NVIDIA platforms.

$184k - $357k

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy. We are focused on solving complex problems across compute, storage, networking, and applied AI. The Token Factory team is developing a cutting-edge inference platform designed to make various foundation models (text, vision, audio, and multimodal) fast, reliable, and effortlessly deployable at massive scale.

Nebius is building a full-stack AI cloud platform to support developers and enterprises in AI/ML infrastructure. This senior systems engineering role focuses on diagnosing and resolving complex hardware and platform failures in high-performance AI infrastructure. The engineer will work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the root cause of issues, developing new troubleshooting procedures for ambiguous problems. The role requires strong ownership, curiosity, and the ability to turn ambiguous problems into evidence-based conclusions.

$180k - $224k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are looking for a Lead Software Systems Engineer - GPU Performance to play a key role in building our hyperscaler platform. This role involves analyzing and optimizing the performance of large-scale GPU clusters at the intersection of hardware and software, operating across the full stack from hardware and system software to networking, virtualization, and distributed communication layers.

$170k - $300k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.

$184k - $318k

NVIDIA is seeking a Senior Software Engineer to enhance the Rust experience for CUDA Core Libraries. This role involves designing and implementing safe, idiomatic Rust APIs for GPU computing, while integrating closely with existing C/C++ components. You will be part of the team responsible for building the foundational libraries, algorithms, and infrastructure that power CUDA, ensuring a high-performance experience for developers and AI coding agents.

$184k - $357k

You will design and build the core infrastructure that powers AI inference across Cloudflare's global network. This includes real-time voice, frontier open LLMs, and customer-deployed models running on a heterogeneous fleet of GPUs and next-generation accelerators. You will work alongside AI/ML engineers, hardware partners, and Cloudflare product teams to solve complex problems in distributed systems and high-performance computing. The role involves addressing challenges such as sub-second model cold starts, multi-accelerator workload scheduling, efficient KV cache management, and developing a model deployment platform for both internal use and customer models. This is an opportunity to be at the center of building a novel AI inference platform embedded in the fabric of the internet, defining how AI runs at the edge of the network.

$194k - $266k

You will help define how machine learning models run across Cloudflare’s global network, from frontier open LLMs and real-time voice models to customer-deployed models served on heterogeneous GPUs and next-generation accelerators. You’ll work with systems engineers, product teams, hardware partners, and AI/ML engineers to bring models into production with low latency, strong reliability, and efficient resource use. This role combines applied ML, inference optimization, evaluation, and production engineering, with a focus on benchmarking models, improving serving performance, validating quality, and building tooling that helps Cloudflare and its customers ship AI applications at Internet scale.

$194k - $266k

NVIDIA is seeking a highly motivated senior software engineer to join its communication libraries and network software team. This role involves developing and maintaining software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. You will be instrumental in designing and implementing highly-optimized communication runtimes and system software that enables interactions among GPUs and with other system components, contributing to the advancement of AI and HPC.

$152k - $288k

Anthropic

As a TPU Kernel Engineer, you will be responsible for identifying and addressing performance issues across various ML systems, including research, training, and inference. A significant part of this role involves designing and optimizing kernels specifically for the TPU. You will also provide crucial feedback to researchers regarding how model changes affect performance. The ideal candidate will have a proven history of solving large-scale systems problems and demonstrating expertise in low-level optimization.

$280k - $850k

Together AI

As a Technical Support Engineer at a pioneering AI company, you will be the first line of defense supporting customers building training, fine-tuning, and inference solutions. You will address complex technical challenges, provide effective solutions, and act as a product expert. Collaborating with product and sales teams, you will contribute to the continuous improvement of offerings. This role is for a technically proficient individual passionate about AI and customer success, seeking to make a significant impact in a fast-paced, innovative environment.

$160k - $230k

NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further!

$184k - $357k