AI Infrastructure Engineer Jobs

SpaceXSI is building one of the world's largest AI supercomputers from the ground up. As part of the Compute Infrastructure team, you will own both the raw GPU supercomputer and the platform layer that runs on top of it. You will work across the full stack—from low-level GPU kernel optimizations and Linux kernel internals to massive-scale orchestration and virtualization—to make training and inference at SpaceXSI as fast, reliable, and scalable as possible. This is a broad, high-impact role that combines hardcore supercompute and compute infrastructure work. Your contributions will directly accelerate Grok's training speed and overall AI progress.

$180k - $440k

Perplexity AI

Perplexity is seeking a Member of Technical Staff to join their GPU Cluster Infrastructure team. This role will own the underlying GPU infrastructure that powers Perplexity's AI inference requests, which serve hundreds of millions of queries monthly. The goal is to abstract away the complexity of GPU provisioning, cluster configuration, and multi-cloud management into a unified, self-serve platform for both training and inference workloads. You will be responsible for the entire lifecycle of the GPU fleet, ensuring reliability, efficient capacity utilization, and seamless operation across different cloud providers.

$250k - $485k

NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.

$184k - $357k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping them with human-level intelligence for home and commercial markets. The Helix team is looking for an experienced Data Infrastructure Engineer to advance the AI data infrastructure. This role involves building tools and software components for robot data management, including offloading, storage, manipulation, and access, while managing on-premise and cloud resources and providing production support. The ideal candidate will have experience building tools and infrastructure for large-scale autonomous or deep learning systems.

$150k - $400k

SambaNova

As a Principal Cloud Platform Engineer, you will specialize in our AI Inferencing Service, acting as the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational challenges. Your primary focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient resource utilization, directly impacting the experience of our customers and the success of our AI products. This role includes participating in a shared on-call rotation to maintain 24/7 service reliability.

$210k - $280k

NVIDIA DGX Cloud is seeking a Senior Software Engineer to join the Bare Metal Infrastructure team. This role focuses on building and maintaining the software that transforms new hardware into reliable, production-ready GPU capacity for demanding AI workloads. The ideal candidate will have deep systems engineering expertise, understanding the intricacies of servers, firmware, BMCs, and networks. You will be involved in the entire bare-metal lifecycle, from new platform introduction and firmware qualification to automated provisioning, validation, and remediation. The team heavily utilizes AI agents and LLM tools in its development process, and we are looking for someone eager to expand these capabilities.

$152k - $288k

NVIDIA is seeking a Systems & Software Engineer to build and manage reliable, large-scale infrastructure platform services. This role involves creating and supporting automation for infrastructure management, specifically for EDA platforms running on NVIDIA hardware. You will be responsible for designing, building, deploying, and running infrastructure services, managing their software lifecycle, and developing automation to eliminate manual tasks and enable scaling. The role also includes defining internal service level objectives and error budgets as part of an observability strategy, practicing incident prevention and response, and consulting with peer teams on systems design best practices.

$184k - $357k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a Senior HPC Cluster Engineer to join our GPU & InfiniBand team, focusing on enhancing and optimizing core components of our hyperscaler platform. This role involves working closely with GPU computing, InfiniBand networks, and the KVM/QEMU stack, ensuring high performance and security in multi-GPU, HPC environments. You will analyze, troubleshoot, and improve infrastructure to support new hardware, fine-tune system performance, and automate fault detection and resolution in a complex system.

Salary not listed

SambaNova

SambaNova is seeking a Senior Principal Cloud Platform Engineer to set the technical direction for their AI inferencing platform, ensuring it remains reliable, fast, and scalable. This role focuses on optimizing uptime, latency, and resource utilization for customer-facing inference endpoints. The work involves monitoring, deployment, capacity planning, and incident response, with a shared on-call rotation for 24/7 coverage. The engineer will also act as a technical leader for the Bengaluru team, mentoring others and shaping platform practices across global regions.

INR 8900k - INR 10800k

Assort Health

Assort Health is building a continuous conversation for every patient, powered by an AI agent that remembers context and personal preferences. This AI-driven healthcare platform aims to revolutionize patient interactions, moving beyond the current system's forgetfulness. The company has experienced significant growth, with substantial funding and recognition, and is seeking individuals passionate about making healthcare more accessible.

$190k - $240k

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Mercor is seeking an AI Infrastructure Engineer to build and manage the GPU and accelerator platform that powers our AI workloads. This role involves overseeing clusters, schedulers, training and inference serving, and the observability and cost data associated with fleet usage. You will write production code daily and own systems end-to-end, from design to on-call responsibilities. Mercor is a leading AI data company, building the layer between human expertise and frontier models, with a mission to organize human intelligence to power the AI economy. We are a profitable Series C company valued at $10 billion.

$200k - $400k

Figma is seeking a hands-on engineering leader to manage and grow its AI Infrastructure team. This team builds the foundational inference systems that power Figma's AI products, ensuring reliability, observability, and seamless integration of cutting-edge models. The role involves defining and executing technical strategy, collaborating across engineering, and directly contributing to the core AI platform. This is an opportunity to join a rapidly growing team at the ground floor and shape the future of AI at Figma.

$258k - $376k

Baseten

Baseten is seeking a Software Engineer to join the Agent Infra team, focusing on building and enhancing Agent Drive, a distributed filesystem critical for agent sandboxes. This role involves developing a storage solution that supports thousands of concurrent sandbox mounts with strict data isolation and consistency. The work leverages advanced storage techniques like tiered caching, replication, and content-addressed data, with a focus on Linux filesystem internals. The team operates with a high degree of ownership, shipping features rapidly and contributing to the core infrastructure that powers leading AI companies.

$160k - $330k

Salesforce is seeking a Senior Infrastructure Engineer to join the Digital Enterprise Technology (DET) organization. This role will focus on the development, management, and administration of key portfolio management tools like Linear and Airtable, as well as AI tools such as Claude/ChatGPT Enterprise. You will collaborate with engineering, program, and business teams to design effective workflows, integrations, and governance models that enable efficient work planning and tracking at an enterprise scale. This position is crucial for the successful deployment and expansion of these platforms across DET, driving innovation and supporting the company's AI-driven vision.

$149k - $224k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

Figma is seeking infrastructure and platform-minded engineers to join our AI Platform team. This team builds the core frameworks, abstractions, and systems that power AI features across Figma, enabling new capabilities for AI product teams and improving performance, reliability, and technical quality. You will contribute to agent infrastructure, context retrieval & ranking platforms, and core AI services to accelerate critical company-wide AI initiatives. This role involves supporting end-to-end AI feature development by designing, building, and maintaining scalable, reliable, and performant systems, collaborating with cross-functional teams, and shaping platform strategy and best practices.

$153k - $376k

Nebius is seeking a Senior Software Systems Engineer to join their team and contribute to the development of their AI cloud platform. This role focuses on enhancing and optimizing core components related to GPU computing and InfiniBand networks, including KVM/QEMU stack. You will work with hardware virtualization and device emulation technologies to ensure high performance and security in multi-GPU, HPC environments. The position involves analyzing, troubleshooting, and improving infrastructure, fine-tuning system performance, and automating fault detection and resolution within a complex system.

$170k - $300k

NVIDIA's DSX OS transforms GPU infrastructure into a multi-tenant platform for AI teams, offering scheduling, orchestration, serving, and observability for AI workloads at data-center scale. The DSX OS Platform Software group develops this layer through projects like KAI-Scheduler, Snapshot, Grove, and Run:ai, contributing to the open-source cloud-native and AI serving ecosystems. The team prioritizes performance, reliability at scale, and providing users with insights into their workloads. We are seeking skilled software engineers to design and build scalable, high-performance systems, solve complex distributed-systems problems, and collaborate with experts to support the next generation of AI workloads.

Salary not listed

Run:ai, now part of NVIDIA, is seeking a Senior Software Engineer to develop tools that empower engineers in creating, validating, and contributing software with confidence. This role will focus on shaping how contributions are tested and integrated, enhancing developer feedback mechanisms, and safeguarding NVIDIA's codebase and internal assets, especially as the company expands its open-source ecosystem and adopts agentic development practices. You will work across various domains including developer tooling, compatibility validation, scale testing, and AI-assisted contribution workflows, building essential infrastructure for both internal engineering teams and the broader open-source community.

Salary not listed

Baseten

Baseten powers mission-critical inference for leading AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling. We enable companies at the frontier of AI to bring cutting-edge models into production. The Agent Infra team builds a custom networking stack for our sandboxes, designed for the scale of numerous isolated machines that constantly suspend, resume, and exchange data. This role focuses on building a user-space networking stack using VPP, enabling multi-tenant virtual private networking for agents and services.

$160k - $330k

Turing

Turing is seeking a Senior Software Engineer to join their AI Evaluation Infrastructure team. This role focuses on building the core infrastructure that frontier AI labs use to evaluate coding agents and language models. You will be responsible for designing and implementing features across the entire stack, from data models and background jobs to user-facing interfaces. The ideal candidate is an experienced, independent engineer who can translate loosely defined requests into robust, tested, and reliable solutions. This position offers the opportunity to work on cutting-edge AI evaluation tools and contribute to the advancement of AI capabilities.

$170k - $200k

OpenAI

OpenAI's Forward Deployed Engineering team partners with customers to turn research breakthroughs into production systems, operating at the intersection of customer delivery and core platform development. As a Forward Deployed Engineer for AI Infra, you will lead complex deployments of frontier models in production, embedding with customers where model performance and urgent delivery are critical. You will work directly with customer engineers, researchers, and product engineers on optimization problems across semiconductors and AI infrastructure, writing and debugging software, running experiments, and improving tools. Your role involves defining problems, structuring delivery, and shipping fast, with a focus on inference performance and chip-design optimization, ultimately contributing improvements to OpenAI's platform.

$185k - $300k

SambaNova

The SambaStack team is seeking an Engineering Director to lead a software engineering team while remaining a hands-on technical contributor. You will own the growth and effectiveness of your team, the technical quality of their output, and the roadmap for the inference serving platform. You will continue to design systems and write code on the platform's hardest problems, contributing directly as a software engineer on critical platform initiatives.

$245k - $325k