Senior AI Infrastructure Engineer Jobs

NVIDIA DGX Cloud is seeking a Senior Software Engineer to join the Bare Metal Infrastructure team. This role focuses on building and maintaining the software that transforms new hardware into reliable, production-ready GPU capacity for demanding AI workloads. The ideal candidate will have deep systems engineering expertise, understanding the intricacies of servers, firmware, BMCs, and networks. You will be involved in the entire bare-metal lifecycle, from new platform introduction and firmware qualification to automated provisioning, validation, and remediation. The team heavily utilizes AI agents and LLM tools in its development process, and we are looking for someone eager to expand these capabilities.

$152k - $288k

NVIDIA is seeking a Systems & Software Engineer to build and manage reliable, large-scale infrastructure platform services. This role involves creating and supporting automation for infrastructure management, specifically for EDA platforms running on NVIDIA hardware. You will be responsible for designing, building, deploying, and running infrastructure services, managing their software lifecycle, and developing automation to eliminate manual tasks and enable scaling. The role also includes defining internal service level objectives and error budgets as part of an observability strategy, practicing incident prevention and response, and consulting with peer teams on systems design best practices.

$184k - $357k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a Senior HPC Cluster Engineer to join our GPU & InfiniBand team, focusing on enhancing and optimizing core components of our hyperscaler platform. This role involves working closely with GPU computing, InfiniBand networks, and the KVM/QEMU stack, ensuring high performance and security in multi-GPU, HPC environments. You will analyze, troubleshoot, and improve infrastructure to support new hardware, fine-tune system performance, and automate fault detection and resolution in a complex system.

Salary not listed

SambaNova

SambaNova is seeking a Senior Principal Cloud Platform Engineer to set the technical direction for their AI inferencing platform, ensuring it remains reliable, fast, and scalable. This role focuses on optimizing uptime, latency, and resource utilization for customer-facing inference endpoints. The work involves monitoring, deployment, capacity planning, and incident response, with a shared on-call rotation for 24/7 coverage. The engineer will also act as a technical leader for the Bengaluru team, mentoring others and shaping platform practices across global regions.

INR 8900k - INR 10800k

Assort Health

Assort Health is building a continuous conversation for every patient, powered by an AI agent that remembers context and personal preferences. This AI-driven healthcare platform aims to revolutionize patient interactions, moving beyond the current system's forgetfulness. The company has experienced significant growth, with substantial funding and recognition, and is seeking individuals passionate about making healthcare more accessible.

$190k - $240k

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Mercor is seeking an AI Infrastructure Engineer to build and manage the GPU and accelerator platform that powers our AI workloads. This role involves overseeing clusters, schedulers, training and inference serving, and the observability and cost data associated with fleet usage. You will write production code daily and own systems end-to-end, from design to on-call responsibilities. Mercor is a leading AI data company, building the layer between human expertise and frontier models, with a mission to organize human intelligence to power the AI economy. We are a profitable Series C company valued at $10 billion.

$200k - $400k

Figma is seeking a hands-on engineering leader to manage and grow its AI Infrastructure team. This team builds the foundational inference systems that power Figma's AI products, ensuring reliability, observability, and seamless integration of cutting-edge models. The role involves defining and executing technical strategy, collaborating across engineering, and directly contributing to the core AI platform. This is an opportunity to join a rapidly growing team at the ground floor and shape the future of AI at Figma.

$258k - $376k

The AI Center of Excellence is seeking a Senior Principal AI Engineer to serve as a technical expert and thought leader for Mastercard’s enterprise AI infrastructure. This role will shape the architecture and engineering of secure, scalable, production-grade platforms supporting LLM model training and inferencing, machine learning models, large language models (LLMs), agentic AI, and emerging AI capabilities in production. The successful candidate will bring deep expertise in high-performance computing (HPC), GPU and accelerated computing, rack-scale systems architecture, private and hybrid cloud, Kubernetes, high-performance networking and storage, observability, security, and reliability. They will work closely with AI Engineers, Data Scientists, Platform Engineers, Security, Architecture, and Product partners to deliver resilient, cloud-native AI platforms in a highly regulated environment.

$254k - $407k

Salesforce is seeking a Senior Infrastructure Engineer to join the Digital Enterprise Technology (DET) organization. This role will focus on the development, management, and administration of key portfolio management tools like Linear and Airtable, as well as AI tools such as Claude/ChatGPT Enterprise. You will collaborate with engineering, program, and business teams to design effective workflows, integrations, and governance models that enable efficient work planning and tracking at an enterprise scale. This position is crucial for the successful deployment and expansion of these platforms across DET, driving innovation and supporting the company's AI-driven vision.

$149k - $224k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

Figma is seeking infrastructure and platform-minded engineers to join our AI Platform team. This team builds the core frameworks, abstractions, and systems that power AI features across Figma, enabling new capabilities for AI product teams and improving performance, reliability, and technical quality. You will contribute to agent infrastructure, context retrieval & ranking platforms, and core AI services to accelerate critical company-wide AI initiatives. This role involves supporting end-to-end AI feature development by designing, building, and maintaining scalable, reliable, and performant systems, collaborating with cross-functional teams, and shaping platform strategy and best practices.

$153k - $376k

Nebius is seeking a Senior Software Systems Engineer to join their team and contribute to the development of their AI cloud platform. This role focuses on enhancing and optimizing core components related to GPU computing and InfiniBand networks, including KVM/QEMU stack. You will work with hardware virtualization and device emulation technologies to ensure high performance and security in multi-GPU, HPC environments. The position involves analyzing, troubleshooting, and improving infrastructure, fine-tuning system performance, and automating fault detection and resolution within a complex system.

$170k - $300k

NVIDIA's DSX OS transforms GPU infrastructure into a multi-tenant platform for AI teams, offering scheduling, orchestration, serving, and observability for AI workloads at data-center scale. The DSX OS Platform Software group develops this layer through projects like KAI-Scheduler, Snapshot, Grove, and Run:ai, contributing to the open-source cloud-native and AI serving ecosystems. The team prioritizes performance, reliability at scale, and providing users with insights into their workloads. We are seeking skilled software engineers to design and build scalable, high-performance systems, solve complex distributed-systems problems, and collaborate with experts to support the next generation of AI workloads.

Salary not listed

Run:ai, now part of NVIDIA, is seeking a Senior Software Engineer to develop tools that empower engineers in creating, validating, and contributing software with confidence. This role will focus on shaping how contributions are tested and integrated, enhancing developer feedback mechanisms, and safeguarding NVIDIA's codebase and internal assets, especially as the company expands its open-source ecosystem and adopts agentic development practices. You will work across various domains including developer tooling, compatibility validation, scale testing, and AI-assisted contribution workflows, building essential infrastructure for both internal engineering teams and the broader open-source community.

Salary not listed

Turing

Turing is seeking a Senior Software Engineer to join their AI Evaluation Infrastructure team. This role focuses on building the core infrastructure that frontier AI labs use to evaluate coding agents and language models. You will be responsible for designing and implementing features across the entire stack, from data models and background jobs to user-facing interfaces. The ideal candidate is an experienced, independent engineer who can translate loosely defined requests into robust, tested, and reliable solutions. This position offers the opportunity to work on cutting-edge AI evaluation tools and contribute to the advancement of AI capabilities.

$170k - $200k

OpenAI

OpenAI's Forward Deployed Engineering team partners with customers to turn research breakthroughs into production systems, operating at the intersection of customer delivery and core platform development. As a Forward Deployed Engineer for AI Infra, you will lead complex deployments of frontier models in production, embedding with customers where model performance and urgent delivery are critical. You will work directly with customer engineers, researchers, and product engineers on optimization problems across semiconductors and AI infrastructure, writing and debugging software, running experiments, and improving tools. Your role involves defining problems, structuring delivery, and shipping fast, with a focus on inference performance and chip-design optimization, ultimately contributing improvements to OpenAI's platform.

$185k - $300k

SambaNova

The SambaStack team is seeking an Engineering Director to lead a software engineering team while remaining a hands-on technical contributor. You will own the growth and effectiveness of your team, the technical quality of their output, and the roadmap for the inference serving platform. You will continue to design systems and write code on the platform's hardest problems, contributing directly as a software engineer on critical platform initiatives.

$245k - $325k

Lila Sciences is seeking an Associate Director/Director, Inference Engineering to lead the team responsible for the company's model serving platform. This role involves defining how models are served at scale, balancing key performance metrics like latency, throughput, quality, and cost. The position acts as a technical authority, bridging the gap between research and production-grade serving capabilities, and encompasses people leadership, service ownership, cross-functional collaboration, and deep technical expertise in modern LLM serving.

$204k - $348k

Turing

Enterprise AI is building the platform that enables reliable deployment of AI systems across enterprise environments. As a Platform Engineer, you will build and operate the core of Turing’s Enterprise AI platform, including platform services, the model gateway, multi-tenant infrastructure, CI/CD, infrastructure as code, and observability. The central challenge is creating repeatable deployments across environments Turing may not control, including client cloud accounts, dedicated instances, and sovereign installations. This role requires hands-on software engineering and operational ownership, with a focus on building production software and contributing deeply to platform services.

Salary not listed

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a highly skilled ML/AI Engineer to lead and support benchmarking of GPU platforms for machine learning and AI workloads. You will play a critical role in evaluating the performance of GPU-based hardware for various deep learning and AI frameworks, enabling data-driven decisions for platform optimisation and next-generation hardware development. This role involves working closely with hardware and development teams to profile and analyse GPU performance, evaluate and compare GPU performance across different platforms, and debug and optimise ML workloads to run efficiently on GPU hardware.

Salary not listed

Nebius is building a full-stack AI cloud platform to support developers and enterprises in AI/ML infrastructure. This senior systems engineering role focuses on diagnosing and resolving complex hardware and platform failures in high-performance AI infrastructure. The engineer will work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the root cause of issues, developing new troubleshooting procedures for ambiguous problems. The role requires strong ownership, curiosity, and the ability to turn ambiguous problems into evidence-based conclusions.

$180k - $224k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.

$184k - $318k

Nebius is building a full-stack AI cloud platform for the global AI economy, supporting developers and enterprises from data and model training through to production deployment. We are seeking a Staff Software Engineer to focus on the indexing and data processing layer of a novel search engine designed for AI agents. This role involves building systems to ingest, process, and organize massive datasets into efficient, queryable structures, operating on offline and nearline pipelines to ensure data freshness and accessibility for retrieval systems. The position requires designing and implementing large-scale indexing systems capable of handling tens of gigabytes per second across continuously evolving datasets, with a strong emphasis on throughput, scalability, and correctness.

Salary not listed