Senior AI Infrastructure Engineer Jobs

Cloudflare

You will design and build the core infrastructure that powers AI inference across Cloudflare's global network. This includes real-time voice, frontier open LLMs, and customer-deployed models running on a heterogeneous fleet of GPUs and next-generation accelerators. You will work alongside AI/ML engineers, hardware partners, and Cloudflare product teams to solve complex problems in distributed systems and high-performance computing. The role involves addressing challenges such as sub-second model cold starts, multi-accelerator workload scheduling, efficient KV cache management, and developing a model deployment platform for both internal use and customer models. This is an opportunity to be at the center of building a novel AI inference platform embedded in the fabric of the internet, defining how AI runs at the edge of the network.

$194k - $266k

The AI Transformation Department is leading Krafton's company-wide AI transformation (AX). This team supports business units in leveraging AI to innovate work productivity through strategy, technical support, education, and direct execution. The AI DevOps Engineer will focus on building and operating environments that ensure AI/ML outcomes are developed, deployed, tested, and operated safely and efficiently. This role emphasizes designing AI/ML-based prediction and automation frameworks and promoting SRE methodologies across the company, rather than direct infrastructure operation.

Salary not listed

NVIDIA is seeking a Deep Learning Compiler CI and Infrastructure Engineer to join their team in Shenzhen, China. In this role, you will collaborate with deep learning compiler engineers to manage and enhance the CI/CD infrastructure that supports the development lifecycle of NVIDIA's deep learning compiler stacks. You will be responsible for designing and operating scalable CI systems that orchestrate ML workloads across various GPU and accelerator environments, ensuring reliable correctness and performance signals. This position serves as a primary technical contact for CI health, onboarding new projects, and integrating new architectures.

Salary not listed

Cloudflare

AI inference is becoming core infrastructure, and AI Gateway is Cloudflare's solution to provide developers with reliable, observable, secure, and cost-controlled access to multiple AI models across various providers, all at the network edge. This is a hands-on individual contributor role focused on building this critical layer. You will work across the entire stack, from distributed systems and high-throughput APIs to developer-facing tools like SDKs and dashboards, shaping how developers build and operate AI applications on Cloudflare. The ideal candidate thrives in the fast-paced AI ecosystem, building durable infrastructure amidst rapidly changing APIs and models, and is excited about using AI to improve the software development process itself.

$194k - $266k

KRAFTON AI Research is seeking a Lead AI Infrastructure Engineer to build and operate the GPU infrastructure necessary for model development, along with AI platforms based on Kubernetes and Slurm. This role involves managing GPU clusters, model training and experimentation environments, ML pipelines, infrastructure automation, and observability systems to ensure AI workloads for game development and services run stably and efficiently. The position is for a hands-on senior engineer who will operate and enhance existing large-scale GPU infrastructure, design future infrastructure expansions, and ensure stable and efficient utilization by R&D and service teams. You will also contribute to technical reviews and proposals for future computing infrastructure scaling and KRAFTON's GPU and computing operational strategy.

Salary not listed

We are seeking a Senior Forward Deployed Engineer (FDE) to join our AI Infrastructure team. In this role, you will work closely with strategic AI enterprises and high-growth startups, architecting, implementing, and fine-tuning production infrastructure on DigitalOcean's AI-Native Cloud. You will embed directly with customer engineering teams to solve complex infrastructure bottlenecks, optimize GPU cluster performance, and engineer critical inference and training platforms. Your mission is to accelerate the adoption of AI-native systems and shape the future of AI cloud infrastructure for the inference and agentic era.

Salary not listed

We are seeking an AI Inference Platform & Operations Engineer to join our AI Frontier division. This role is crucial for connecting Krafton's AI technologies with actual products and services, and for validating and expanding new business opportunities. You will be responsible for building and operating the inference infrastructure that supports these products, ensuring fast and stable service connections for both proprietary and open-weight models. The mission involves maintaining consistent response times and availability under growing traffic, and efficiently managing GPU resources and inference costs. We foster a culture where opinions are valued regardless of rank or tenure, decisions are executed quickly, and failures are addressed through postmortems to strengthen systems. AI tools are integrated into daily development and operations, and we actively explore and apply new models and serving technologies.

Salary not listed

Turing

Turing is seeking a Senior DevOps & Infrastructure Engineer to join their global Infrastructure Engineering team. This role focuses on building and maintaining the cloud infrastructure and developer platform that powers the company's operations. You will be responsible for making systems more reliable, secure, scalable, and efficient as the company grows. This is a hands-on position for an engineer who thrives on automating manual tasks, solving complex production issues, and elevating operational excellence. You will collaborate closely with application and security teams, working across cloud infrastructure, reliability, developer tooling, and security. The role offers meaningful ownership within a globally distributed team, requiring regular overlap with U.S. Pacific Time working hours and participation in a global on-call rotation.

Salary not listed

Vectara

Vectara is seeking a Senior/Staff Platform Software Engineer to build and scale the core infrastructure powering their AI agent platform. This role involves designing robust services and scalable systems with a focus on automation, observability, reliability, and performance. You will work on AI-assisted coding, lead code and system design reviews, and mentor team members. The position requires designing, implementing, and maintaining scalable and secure backend services, driving infrastructure automation, CI/CD, and monitoring pipelines, and collaborating with product and research teams to deploy and optimize ML/NLP workloads. You will also lead initiatives to improve system reliability and scalability, contribute to architecture decisions, and champion best practices in code quality and DevOps.

Salary not listed

SpaceXAI is seeking an engineer to join our RL infrastructure team and help develop our evaluation infrastructure. This role involves building highly reliable, efficient, and user-friendly systems to run evaluations at scale. You will collaborate with modeling and evaluation teams to develop new evaluations, maintain signal quality, and create internal tooling for training next-generation models. A key part of this role is identifying and resolving performance bottlenecks across the entire evaluation infrastructure stack, including inference, capacity fleet management, and asynchronous evaluation orchestration.

$180k - $440k

Crusoe

Crusoe is seeking a Senior Production Engineer to join their team and ensure the reliability and scalability of their AI-optimized cloud platform. This role is crucial for building and operating managed AI services at scale, focusing on delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive workloads. The ideal candidate will have a strong background in distributed systems and hands-on experience with large language models, contributing to the future of AI infrastructure.

$170k - $205k

Salesforce is seeking a Senior Manager of Software Engineering to lead the DNS Engineering team, which is responsible for the DDI (DNS, DHCP, IPAM) services infrastructure that underpins all Salesforce products. This role involves setting the multi-year strategy for authoritative and recursive DNS across data centers and public clouds, managing self-service DNS and IPAM APIs, and enhancing DNS security, including DNSSEC and DDoS resilience. The ideal candidate will lead the transition to cloud-native, multi-provider DNS with a focus on automation and AI-assisted operations, ensuring the availability and performance of this critical Tier-0 service.

$173k - $260k

Lead performance optimization for large-scale AI workloads, transforming them into faster and more efficient systems. This role involves analyzing and optimizing AI training and inference across distributed systems, connecting compute, memory, and networking behavior. You will lead complex performance workstreams, identify bottlenecks, validate improvements, and translate performance data into actionable engineering decisions. The position requires building benchmarks, profiling demanding workloads, and developing C++ and Python tools for analysis and optimization, ultimately helping teams enhance efficiency, scalability, and reliability. This role offers broad technical scope across AI infrastructure at data center scale.

Salary not listed

As a Principal AI Performance Engineer, you will define how Graphcore analyzes and optimizes AI training and inference workloads, shaping decisions across hardware, software, networking, and system architecture. You will lead complex performance investigations, from model behavior to multi-node scaling, translating profiling, benchmarking, and modeling evidence into technical roadmaps and engineering priorities. This role offers rare influence across AI infrastructure at data center scale, guiding strategy, resolving tradeoffs, and raising performance-engineering standards across the organization.

Salary not listed

As a Senior Software Engineer on the AI Compute Libraries team, you will develop, maintain, and release C++ libraries and runtime APIs that enable engineers to build and execute workloads on Graphcore's AI hardware. Your work will involve designing clear abstractions for low-level hardware capabilities, improving reliability and performance, and supporting developers integrating these libraries into the wider software stack. You will own library changes from design through release and maintenance, ensuring dependable releases with proper packaging, documentation, and fixes. This role requires collaborating with library users to understand requirements, resolve integration issues, and guide API improvements.

Salary not listed

Join our GPU Assembler team to build tools that enable the creation of highly performant applications and libraries for HPC, Deep Learning, and Autonomous Driving. You will collaborate with key HPC developers globally to optimize performance and efficiency on current and next-generation NVIDIA GPUs by developing industry-leading Assembler and Code Analysis Tools. This role involves contributing to a core platform component for accelerating general-purpose computation on the GPU. The team's Disassembler (NVDISASM) is widely used by CUDA users for binary analysis, and the Assembler is crucial for optimizing key Deep Learning applications.

Salary not listed

Crusoe

Crusoe is seeking a highly skilled Software Engineer to join their Data Center Infrastructure Engineering team. This role focuses on developing software for managing a fleet of GPU servers and the data centers that house them. The position involves creating and implementing advanced diagnostic, observability, automation, and repair tooling for high-performance GPU compute clusters. The ideal candidate will be a hands-on problem solver comfortable working independently, playing a critical role in maintaining the health and scalability of Crusoe's rapidly growing GPU fleet.

$170k - $205k

Cohere

Cohere is seeking a Staff Forward Deployed Engineer to bridge the gap between frontier AI capabilities and complex customer realities. This role involves architecting high-performance, resilient machine learning systems within enterprise environments, acting as the primary technical liaison between Cohere's core engineering teams and strategic partners. You will own the architecture for customer-specific inference challenges, ensuring our large language models operate reliably, securely, and at peak performance within client infrastructure. The goal is to achieve exceptionally low latency, high throughput, and seamless resilience in production deployments.

$240k - $415k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping robots with human-level intelligence. These robots are engineered to perform a variety of tasks in home and commercial markets. We are seeking a Staff AI Inference & Acceleration Engineer to join our Platform Software team. This role will be responsible for the on-board inference architecture for our humanoid robots, acting as the technical authority on how AI workloads are mapped, optimized, and executed across the robot's compute hardware. The primary objective is to reduce power consumption and cost while meeting strict latency and reliability demands for a real-time autonomous system.

$180k - $275k

Anthropic

Our team builds the systems that enable every change to Anthropic's software to reach production safely and predictably. This includes managing pipelines, staged rollouts, health-gated promotion, rollback, runtime configuration, and feature flags across a large fleet of machines. You will own a significant part of this end-to-end process, from initial design to ongoing operation in production. If you are passionate about influencing the speed and safety of Anthropic's software releases, this role offers a unique opportunity.

$405k - $485k

SambaNova

As a Principal Cloud Platform Engineer, you will specialize in our AI Inferencing Service, acting as the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational challenges. Your primary focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient resource utilization, directly impacting the experience of our customers and the success of our AI products. This role includes participating in a shared on-call rotation to maintain 24/7 service reliability.

$210k - $280k

Turing

Turing's mission is to accelerate superintelligence to drive real economic progress. The company works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks. Turing also partners with Fortune 500 enterprises to build and deploy end-to-end agentic AI systems within mission-critical workflows. This role involves leading the Turing Enterprise AI Platform technical team, which is being built out for a late 2025 SDK release and a Q1 2027 tenant onboarding. The goal is to grow the team to eight to ten members and collaborate with the Chief AI Architect on client-facing architecture and evaluation.

Salary not listed

NVIDIA is seeking a Senior Software Engineer to join our DSX team. You will build and operate tooling that verifies AI infrastructure readiness for production, focusing on cluster readiness and certification software. This includes working with the open-source Cluster Readiness Engine to validate GPU clusters across Kubernetes and Slurm, measure training and inference performance, and produce trustworthy evidence for customers and partners. You will collaborate with leading AI companies and cloud providers to ensure their infrastructure performs as designed for critical workloads.

$184k - $357k

Mastercard is seeking a Lead AI Platform Engineer to provide technical leadership in designing, implementing, and operating foundational platforms for AI and machine learning workloads. This role operates at the intersection of platform engineering, cloud infrastructure, MLOps, and AI operations, focusing on delivering scalable, secure, and reliable AI infrastructure. You will help shape the platforms, tooling, and operational practices for the next generation of AI capabilities, addressing complex challenges in scalability, reliability, observability, governance, and automation. The ideal candidate combines advanced software engineering and cloud platform expertise with experience supporting production AI/ML systems, and is passionate about technical leadership, automation, and building empowering platforms.

$168k - $277k