Infiniband Jobs

Anduril Industries is seeking a High Performance Computing (HPC) System Engineer to directly support sensitive programs by building and maintaining large-scale HPC infrastructure. This role offers the opportunity to work with leading engineers and cybersecurity professionals on cutting-edge systems deployed globally for national security missions. You will be instrumental in architecting, deploying, and managing advanced GPU infrastructure, ensuring the seamless operation of critical compute environments.

$147k - $196k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.

$200k - $400k

Perplexity is seeking a Member of Technical Staff to join their GPU Cluster Infrastructure team. This role will own the underlying GPU infrastructure that powers Perplexity's AI inference requests, which serve hundreds of millions of queries monthly. The goal is to abstract away the complexity of GPU provisioning, cluster configuration, and multi-cloud management into a unified, self-serve platform for both training and inference workloads. You will be responsible for the entire lifecycle of the GPU fleet, ensuring reliability, efficient capacity utilization, and seamless operation across different cloud providers.

$250k - $485k

NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.

$184k - $357k

Anduril Industries is seeking a Senior AI Infrastructure Engineer to lead the vision, execution, and long-term stability of how the company trains with GPUs at scale. This role involves taking ownership of cluster robustness, ensuring high-performance GPU systems are highly available, fault-tolerant, and resilient for ML platform and research teams. The primary focus is on logical stability and automated resilience, building self-healing mechanisms, tuning networking, and optimizing scheduling to ensure massive-scale training infrastructure runs seamlessly and scales efficiently.

$166k - $220k

Anduril Industries is seeking a Senior AI Infrastructure Engineer to lead the vision, execution, and long-term stability of how the company trains with GPUs at scale. This role involves taking ownership of cluster robustness, ensuring high-performance GPU systems are highly available, fault-tolerant, and resilient for ML platform and research teams. The primary focus is on logical stability and automated resilience, building self-healing mechanisms, tuning networking, and optimizing scheduling to ensure massive-scale training infrastructure runs seamlessly and scales efficiently.

$166k - $220k

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.

$184k - $318k

Databricks

Databricks is seeking a Senior Software Engineer for its AI Runtime (AIR) team. AIR is a managed platform designed for large-scale GPU training and fine-tuning of AI models, providing customers with on-demand access to accelerators and a serverless experience that simplifies the complexities of provisioning, scheduling, and orchestrating multi-node jobs. As a Senior Software Engineer on AIR, you will be instrumental in building and scaling the systems that ensure large-scale training is fast, reliable, and effortless. You will lead the architecture and evolution of the managed GPU training stack, focusing on areas such as scheduling, distributed training performance, fault tolerance, and the developer experience for large-scale job operations. Beyond hands-on system development, you will contribute to the technical vision for AIR, mentor engineers, and collaborate with product, research, and platform teams to expand the impact of custom AI training at Databricks.

$160k - $225k

Databricks

Databricks is seeking a Staff Software Engineer for its AI Runtime (AIR) team. AIR is a managed platform designed for large-scale GPU training and fine-tuning of state-of-the-art AI models, providing customers with on-demand access to accelerators and a serverless experience. As part of this role, you will be instrumental in building and scaling the systems that ensure fast, reliable, and effortless large-scale training. You will influence the architecture and development of the managed GPU training stack, focusing on areas like scheduling, distributed training performance, fault tolerance, and the overall developer experience for operating jobs at scale. This position also involves defining the long-term technical vision for AIR, mentoring senior engineers, and collaborating with product, research, and platform teams to expand the impact of custom training at Databricks.

$190k - $265k

ElevenLabs is seeking an engineer to join their research infrastructure team to ensure their NVIDIA GPU clusters are fast, reliable, and performant. This is a builder-operator role with significant autonomy, where your impact will be directly measured by training throughput and researcher velocity. You will be responsible for the entire stack beneath the training code, from OS images and NVIDIA drivers to high-speed networking and job scheduling. The role involves both hands-on hardware work and writing automation to eliminate manual tasks, with a focus on maintaining cluster security and performance.

We are seeking software engineers to develop next-generation high-speed interconnect technologies for GPU and high-performance computing servers. This role involves close collaboration with hardware architects, silicon designers, and platform software experts to drive innovation in factories and data centers. The ideal candidate will possess strong C++ programming skills, a deep understanding of networking concepts, systems software fundamentals, and current hardware architecture. Excellent communication and meticulous engineering practices are essential for providing robust and efficient solutions to validate and test next-generation processors.

$184k - $357k

NVIDIA is seeking an AI Compute Engineer to join its Infrastructure Specialists team. This role involves working on some of the world's largest and fastest AI Compute systems, supporting academic, commercial, and government groups. The engineer will interact with customers, partners, and internal teams to analyze, define, and implement large-scale AI Compute projects, encompassing networking, system design, automation, and validation.

$124k - $196k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This is an architect-and-build role where you will set the architecture for automated bootstrapping of GPU data centers, high-performance virtualization, and fault-tolerant decentralized control planes, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer up to the global management plane that schedules capacity across all data centers. At this level, the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships.

$260k - $300k

Together AI

As a Customer Success Engineer at Together AI, you will be the named technical owner for one of our most strategic customer relationships. You will serve as the primary technical point of contact across all infrastructure domains, including compute, networking, storage, and facilities, ensuring the flawless delivery and operational health of large-scale GPU deployments. This role is crucial for driving both customer success and company growth by combining deep infrastructure expertise with high-stakes customer partnerships.

$260k - $290k

NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. You will deliver hands-on technical assistance for advanced AI deployments, intricate distributed systems, and ensure customers realize efficient performance from NVIDIA's AI platform across varied environments. We partner with the world's most innovative AI companies to address their most challenging technical problems. In this role, you will develop innovative solutions that advance AI infrastructure capabilities and directly influence customer success with breakthrough AI initiatives.

$184k - $357k