AI Infrastructure Engineer Jobs

NVIDIA is seeking a motivated Performance Engineer to join our GPU Communications Libraries and Networking team. This role involves influencing the roadmap of communication libraries that are critical for Deep Learning and High Performance Computing applications running on massive GPU clusters. You will analyze and optimize communication performance between GPUs, which directly impacts end-to-end application performance at scale. This is an excellent opportunity to advance the state of the art in GPU communication and contribute to NVIDIA's innovative technologies.

$152k - $288k

NVIDIA is seeking a Senior Systems Software Engineer to focus on GPU Performance at Scale. In this role, you will drive innovation in AI and GPU computing by contributing to world-class computing hardware and software. You will provide insights into large-scale system composition and tuning for high-performance compute runs, collaborating with researchers, developers, and customers to create improved workflows and develop new solutions. You will also engage with HPC, OS, CPU, GPU compute, and systems specialists to architect, build, and optimize large-scale performance platforms.

$184k - $357k

Cloudflare

Cloudflare MCP Server Portals provide organizations with a secure, centralized method to connect AI agents to internal and third-party tools. As a Systems Engineer on the MCP Portals team, you will be responsible for building and operating the distributed systems that handle user authentication, OAuth credential and session management, Zero Trust policy enforcement, and MCP traffic proxying across Cloudflare's global network. You will manage projects from their initial design through to their rollout and ongoing production support, collaborating with engineers and product managers from various teams. The ideal candidate will be adept at making sound technical decisions, navigating complex system problems, and taking ownership of the services they develop.

€54k - €75k

NVIDIA is seeking a Deep Learning Compiler CI and Infrastructure Engineer to join their team in Shenzhen, China. In this role, you will collaborate with deep learning compiler engineers to manage and enhance the CI/CD infrastructure that supports the development lifecycle of NVIDIA's deep learning compiler stacks. You will be responsible for designing and operating scalable CI systems that orchestrate ML workloads across various GPU and accelerator environments, ensuring reliable correctness and performance signals. This position serves as a primary technical contact for CI health, onboarding new projects, and integrating new architectures.

Salary not listed

Cloudflare

You will design and build the core infrastructure that powers AI inference across Cloudflare's global network. This includes real-time voice, frontier open LLMs, and customer-deployed models running on a heterogeneous fleet of GPUs and next-generation accelerators. You will work alongside AI/ML engineers, hardware partners, and Cloudflare product teams to solve complex problems in distributed systems and high-performance computing. The role involves addressing challenges such as sub-second model cold starts, multi-accelerator workload scheduling, efficient KV cache management, and developing a model deployment platform for both internal use and customer models. This is an opportunity to be at the center of building a novel AI inference platform embedded in the fabric of the internet, defining how AI runs at the edge of the network.

$194k - $266k

Cloudflare

AI inference is becoming core infrastructure, and AI Gateway is Cloudflare's solution to provide developers with reliable, observable, secure, and cost-controlled access to multiple AI models across various providers, all at the network edge. This is a hands-on individual contributor role focused on building this critical layer. You will work across the entire stack, from distributed systems and high-throughput APIs to developer-facing tools like SDKs and dashboards, shaping how developers build and operate AI applications on Cloudflare. The ideal candidate thrives in the fast-paced AI ecosystem, building durable infrastructure amidst rapidly changing APIs and models, and is excited about using AI to improve the software development process itself.

$194k - $266k

Harvey is transforming legal and professional services by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise. This role is an opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team moves fast, takes ownership, and is deeply committed to the mission, operating with intensity and pushing for excellence. As a Member of Technical Staff, Infrastructure, you will build the systems that power how we adapt and improve leading open-weight models for legal work, focusing on scaling post-training efforts and owning the infrastructure behind distributed training, RL rollouts, agent environments, and internal tooling for data management, evals, and job tracking.

$230k - $340k

Turing

Turing is seeking a Senior DevOps & Infrastructure Engineer to join their global Infrastructure Engineering team. This role focuses on building and maintaining the cloud infrastructure and developer platform that powers the company's operations. You will be responsible for making systems more reliable, secure, scalable, and efficient as the company grows. This is a hands-on position for an engineer who thrives on automating manual tasks, solving complex production issues, and elevating operational excellence. You will collaborate closely with application and security teams, working across cloud infrastructure, reliability, developer tooling, and security. The role offers meaningful ownership within a globally distributed team, requiring regular overlap with U.S. Pacific Time working hours and participation in a global on-call rotation.

Salary not listed

Vectara

Vectara is seeking a Senior/Staff Platform Software Engineer to build and scale the core infrastructure powering their AI agent platform. This role involves designing robust services and scalable systems with a focus on automation, observability, reliability, and performance. You will work on AI-assisted coding, lead code and system design reviews, and mentor team members. The position requires designing, implementing, and maintaining scalable and secure backend services, driving infrastructure automation, CI/CD, and monitoring pipelines, and collaborating with product and research teams to deploy and optimize ML/NLP workloads. You will also lead initiatives to improve system reliability and scalability, contribute to architecture decisions, and champion best practices in code quality and DevOps.

Salary not listed

SpaceXAI is seeking an engineer to join our RL infrastructure team and help develop our evaluation infrastructure. This role involves building highly reliable, efficient, and user-friendly systems to run evaluations at scale. You will collaborate with modeling and evaluation teams to develop new evaluations, maintain signal quality, and create internal tooling for training next-generation models. A key part of this role is identifying and resolving performance bottlenecks across the entire evaluation infrastructure stack, including inference, capacity fleet management, and asynchronous evaluation orchestration.

$180k - $440k

Crusoe

Crusoe is seeking a Senior Production Engineer to join their team and ensure the reliability and scalability of their AI-optimized cloud platform. This role is crucial for building and operating managed AI services at scale, focusing on delivering highly available, performant, and cost-efficient AI infrastructure for compute-intensive, latency-sensitive workloads. The ideal candidate will have a strong background in distributed systems and hands-on experience with large language models, contributing to the future of AI infrastructure.

$170k - $205k

Salesforce is seeking a Senior Manager of Software Engineering to lead the DNS Engineering team, which is responsible for the DDI (DNS, DHCP, IPAM) services infrastructure that underpins all Salesforce products. This role involves setting the multi-year strategy for authoritative and recursive DNS across data centers and public clouds, managing self-service DNS and IPAM APIs, and enhancing DNS security, including DNSSEC and DDoS resilience. The ideal candidate will lead the transition to cloud-native, multi-provider DNS with a focus on automation and AI-assisted operations, ensuring the availability and performance of this critical Tier-0 service.

$173k - $260k

SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.

$180k - $440k

Lead performance optimization for large-scale AI workloads, transforming them into faster and more efficient systems. This role involves analyzing and optimizing AI training and inference across distributed systems, connecting compute, memory, and networking behavior. You will lead complex performance workstreams, identify bottlenecks, validate improvements, and translate performance data into actionable engineering decisions. The position requires building benchmarks, profiling demanding workloads, and developing C++ and Python tools for analysis and optimization, ultimately helping teams enhance efficiency, scalability, and reliability. This role offers broad technical scope across AI infrastructure at data center scale.

Salary not listed

As a Principal AI Performance Engineer, you will define how Graphcore analyzes and optimizes AI training and inference workloads, shaping decisions across hardware, software, networking, and system architecture. You will lead complex performance investigations, from model behavior to multi-node scaling, translating profiling, benchmarking, and modeling evidence into technical roadmaps and engineering priorities. This role offers rare influence across AI infrastructure at data center scale, guiding strategy, resolving tradeoffs, and raising performance-engineering standards across the organization.

Salary not listed

As a Senior Software Engineer on the AI Compute Libraries team, you will develop, maintain, and release C++ libraries and runtime APIs that enable engineers to build and execute workloads on Graphcore's AI hardware. Your work will involve designing clear abstractions for low-level hardware capabilities, improving reliability and performance, and supporting developers integrating these libraries into the wider software stack. You will own library changes from design through release and maintenance, ensuring dependable releases with proper packaging, documentation, and fixes. This role requires collaborating with library users to understand requirements, resolve integration issues, and guide API improvements.

Salary not listed

Join our GPU Assembler team to build tools that enable the creation of highly performant applications and libraries for HPC, Deep Learning, and Autonomous Driving. You will collaborate with key HPC developers globally to optimize performance and efficiency on current and next-generation NVIDIA GPUs by developing industry-leading Assembler and Code Analysis Tools. This role involves contributing to a core platform component for accelerating general-purpose computation on the GPU. The team's Disassembler (NVDISASM) is widely used by CUDA users for binary analysis, and the Assembler is crucial for optimizing key Deep Learning applications.

Salary not listed

Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed systems. The Software Infrastructure team provides critical platforms and services for software development teams across the business, managing the CI platform and services, build engineering, component integration, and packaging and release systems.

Salary not listed

Crusoe

Crusoe is seeking a highly skilled Software Engineer to join their Data Center Infrastructure Engineering team. This role focuses on developing software for managing a fleet of GPU servers and the data centers that house them. The position involves creating and implementing advanced diagnostic, observability, automation, and repair tooling for high-performance GPU compute clusters. The ideal candidate will be a hands-on problem solver comfortable working independently, playing a critical role in maintaining the health and scalability of Crusoe's rapidly growing GPU fleet.

$170k - $205k

Cohere

Cohere is seeking a Staff Forward Deployed Engineer to bridge the gap between frontier AI capabilities and complex customer realities. This role involves architecting high-performance, resilient machine learning systems within enterprise environments, acting as the primary technical liaison between Cohere's core engineering teams and strategic partners. You will own the architecture for customer-specific inference challenges, ensuring our large language models operate reliably, securely, and at peak performance within client infrastructure. The goal is to achieve exceptionally low latency, high throughput, and seamless resilience in production deployments.

$240k - $415k

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping robots with human-level intelligence. These robots are engineered to perform a variety of tasks in home and commercial markets. We are seeking a Staff AI Inference & Acceleration Engineer to join our Platform Software team. This role will be responsible for the on-board inference architecture for our humanoid robots, acting as the technical authority on how AI workloads are mapped, optimized, and executed across the robot's compute hardware. The primary objective is to reduce power consumption and cost while meeting strict latency and reliability demands for a real-time autonomous system.

$180k - $275k

Anthropic

Our team builds the systems that enable every change to Anthropic's software to reach production safely and predictably. This includes managing pipelines, staged rollouts, health-gated promotion, rollback, runtime configuration, and feature flags across a large fleet of machines. You will own a significant part of this end-to-end process, from initial design to ongoing operation in production. If you are passionate about influencing the speed and safety of Anthropic's software releases, this role offers a unique opportunity.

$405k - $485k

SambaNova

As a new grad Cloud Platform Engineer, you will write automation and infrastructure code to ensure the SambaNova inference service remains fast and available. This role involves building monitoring and dashboards, managing Kubernetes clusters and Terraform modules, and assisting with the setup of new regions. Upon ramp-up, you will join a shared on-call rotation to support production operations.

$131k - $197k

Turing

Turing's mission is to accelerate superintelligence to drive real economic progress. The company works with frontier AI labs to generate high-quality datasets, reinforcement learning environments, and frontier research benchmarks. Turing also partners with Fortune 500 enterprises to build and deploy end-to-end agentic AI systems within mission-critical workflows. This role involves leading the Turing Enterprise AI Platform technical team, which is being built out for a late 2025 SDK release and a Q1 2027 tenant onboarding. The goal is to grow the team to eight to ten members and collaborate with the Chief AI Architect on client-facing architecture and evaluation.

Salary not listed