AI Infrastructure Engineer Jobs

FAR.AI is seeking a Tech Lead Manager for its GPU Cluster Infrastructure team. This role involves leading a sub-team focused on managing and scaling the organization's GPU compute platform, which supports cutting-edge AI safety research. You will be responsible for the technical direction and roadmap of the platform, ensuring its performance, fault tolerance, and security, especially as AI agents increasingly utilize the cluster for experiments. This position requires a blend of technical expertise and leadership, with at least half of your time dedicated to hands-on engineering work. You will also be responsible for hiring and growing the infrastructure team, setting priorities, and providing mentorship.

$225k - $325k

Relevance AI is building the future of the AI workforce, empowering teams to delegate meaningful work to intelligent AI agents. Our platform enables the creation and management of agents that handle complex workflows and decisions, already used by industry leaders. We are backed by prominent investors and have secured Series B funding to accelerate growth. Headquartered in San Francisco and Sydney, we operate on a hybrid model focused on curiosity, collaboration, and execution. This role is crucial for building the factory that ships every feature, focusing on an end-to-end system where coding agents can pick up, build, test, review, and deploy tasks safely and at speed. You will own the developer experience, platform infrastructure, and reliability, shaping the foundations of our AI-native platform and multiplying the output of every engineer and agent.

Salary not listed

We are seeking a Senior Technical Support Engineer with deep expertise in Ethernet networking and AI infrastructure. In this customer-facing role, you will own complex technical investigations and critical escalations involving large-scale data center and AI environments. You will serve as a trusted technical advisor to strategic customers, combining strong troubleshooting skills with excellent communication, crisis management, and technical leadership. You will collaborate closely with Engineering, Product Management, Marketing, and Support teams to resolve issues and improve our products and support practices.

Salary not listed

FAR.AI is seeking a Senior Software Engineer to join their Foundations team, which is responsible for the institute's compute platform, research tools, and workflow automation. This role will focus on accelerating AI safety research by managing and scaling the GPU cluster fleet, which includes bare-metal and managed Kubernetes environments. The engineer will work directly with researchers and other engineers to ensure large-scale experiments are performant and fault-tolerant, contributing to the core infrastructure that enables cutting-edge AI safety advancements.

$150k - $275k

Luma is seeking a Software Engineer to own the serving of their AI models. This role involves integrating new model architectures into the inference engine, scaling deployments across thousands of machines, and optimizing the utilization of expensive GPU fleets while meeting internal service level objectives (SLOs). The work focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and ensuring reliability across diverse clusters and hardware providers. This position is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale, rather than those seeking pure modeling work.

$195k - $345k

Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.

$195k - $395k

Lovable is seeking an infrastructure engineer to build the data ingestion, storage, and query systems that power their agentic software creation platform. This role is crucial for ensuring the reliability of data for applications built on Lovable. The company is a fast-growing AI company based in Stockholm, with a culture of ownership, velocity, and collaboration. They are looking for individuals who are passionate about making a significant impact in the next era of software development.

Salary not listed

NVIDIA is seeking a highly skilled and motivated Senior CUDA Test Development Software Engineer to join our CUDA Test Development team in Shanghai, China. This team is responsible for all aspects of quality assurance for CUDA products, including regression testing, release testing, test automation, and test development, ensuring the highest quality standards. We are looking for individuals passionate about AI computing and working with brilliant technical people across countries.

Salary not listed

Lambda, The Superintelligence Cloud, is seeking a Senior Systems Engineer to join their Enterprise AI Platforms team. This role focuses on building and scaling the internal systems that power Lambda's business, partnering across departments to implement tools, automate workflows, and ensure data integrity. You will be instrumental in designing, developing, and deploying software and services to enhance the availability, scalability, reliability, and efficiency of Lambda’s internal IT systems and platforms. The position requires a proactive approach to problem-solving, automation, and influencing the creation of new architectures for large-scale distributed systems, with a strong emphasis on AI infrastructure and tooling.

$206k - $275k

Anthropic

Anthropic's Environments organization is responsible for building and maintaining the infrastructure that enhances Claude's capabilities through reinforcement learning. This includes developing frameworks for researchers to build environments and the underlying infrastructure for running them, with a core mission to productionize research. The role involves embedding with research teams to understand their workflows and designing frameworks and APIs that accelerate their progress, ensuring these systems are understandable, ownable, and maintainable. A significant part of the role also includes ensuring the health, maintainability, monitoring, and ease of triage for production RL runs. The ideal candidate will possess deep Python expertise, a strong sense of API and framework design, and an intuitive understanding of complex system failures, particularly silent ones. Experience with stateful distributed systems like workflow engines or actor frameworks is a plus. The role requires comfort in navigating and abstracting complex research codebases, incrementally improving them while research continues, and leveraging AI tools for development with a focus on verification.

$405k - $605k

Tenstorrent is seeking a Workload Performance Optimization Engineer to enhance the performance of software workloads on next-generation RISC-V platforms. This role involves optimizing modern datacenter and agentic AI workloads across various programming languages like Java, Python, and Rust. You will identify performance bottlenecks and develop optimizations at the software, compiler, runtime, and hardware levels to improve throughput, latency, and efficiency. The position bridges software runtimes, compilers, CPU microarchitecture, and RISC-V silicon, requiring profiling of real-world applications, investigating memory and concurrency, and leveraging RISC-V capabilities. You will also contribute to AI-assisted development and automated optimization workflows, directly impacting the RISC-V software ecosystem and future CPU architectures.

$100k - $500k

Lightning AI is seeking an experienced Senior GPU & Compute Infrastructure Engineer to join their Infrastructure Engineering team. This role focuses on bringing up, validating, and operating large-scale bare-metal compute infrastructure, with a strong emphasis on GPU-enabled systems. You will work at the intersection of hardware, systems, and software, owning system diagnostics, validation, automation development, reliability improvements, and ensuring clusters are ready for demanding AI/ML and HPC workloads. The position involves GPU and system-level qualification, running validation environments and test clusters, and enhancing tooling and workflows for infrastructure bring-up at scale, including managing image pipelines and provisioning systems for consistency, performance, and reliability.

$180k - $220k

Crusoe

Crusoe is building the operating system for AI datacenters, managing one of the world's largest GPU fleets. This role focuses on building a unified platform that senses, reasons about, and acts on the entire fleet, moving beyond traditional operational methods to achieve fleet autonomy. The platform is designed as a product with an API-first approach, offering SDKs, paved paths, and a self-serve portal for internal teams. It comprises agents for telemetry and command execution, a distributed infra graph, a reconciliation core for state management, and domain services for various operational tasks. The goal is to create an autonomous system that continuously improves through a sense-correlate-reason-act-learn loop, reducing manual interventions and enabling other teams to build services and workflows efficiently.

$250k - $300k

Baseten

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

sarvam

Sarvam is building the bedrock of Sovereign AI for India, developing a full-stack AI platform focused on research, models, infrastructure, and applications. This role owns the infrastructure for training foundational models at scale, involving deep systems work such as distributed training, parallelism strategies, GPU kernel optimization, and reliability engineering. The position demands a high level of expertise to identify and resolve complex issues that can significantly impact training timelines and costs.

Salary not listed

Reducto

Reducto is seeking a Software Engineer for its Platform team to own the infrastructure behind the company's core API. This role involves ensuring document understanding systems are fast, reliable, and cost-efficient at scale. You will work across Python services, queues, model-serving, Kubernetes, observability, and developer tooling to enhance the platform's robustness. This is a high-leverage infrastructure position for someone who has built and operated production systems, prioritizes latency, reliability, and cost, and is adept at using modern LLM coding tools.

$200k - $325k

Join our Conversation Engine team to scale and optimize a cutting-edge Generative AI product that provides instant assistance to enterprise users. You will work at the core of Moveworks' Generative AI product, focusing on scaling and optimizing it for the enterprise solution space. We encourage innovative ideas to solve unsolved problems, collaborating closely with machine learning experts and cross-functional teams to rapidly iterate on new ideas and leverage user behavior data. Your challenge will be to scale and optimize our conversation engine to support hundreds of millions of users across multiple chat channels and use cases, enhancing our end-to-end product infrastructure with engineering quality and robustness.

$176k - $308k

Percepta

Percepta is seeking an AI Infrastructure Engineer to take ownership of the infrastructure, deployment, and operational reliability for Percepta's AI systems, including autonomous agents. This role involves hardening existing infrastructure, strengthening deployment pipelines, and defining new SRE practices for operating autonomous systems. You will be instrumental in bridging the gap between AI research and production, contributing to the foundational decisions that shape the future of agentic infrastructure.

$180k - $400k

Databricks

At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems by building and running the world's best data and AI infrastructure platform. As part of the AI Platform team, you will build the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search. You will be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses helping thousands of our customers democratize AI within their organizations, and we are building the infrastructure that powers the next generation of AI.

$166k - $225k

Code Metal

Code Metal is seeking a Staff AI Platform Engineer to architect and build the foundational AI enablement stack that internal engineering teams rely on. This role involves designing and operating production systems for GPU inference serving, model gateways, agent harnesses, context management, and observability. While primarily an engineering role focused on building and operating production systems, it also requires solid data science and AI research fundamentals to work closely with the AI Research team and conduct experiments when necessary. The platform is built to product standards, ensuring reliability and scalability for AI-driven code transpilation, modernization, optimization, modeling, and simulation solutions.

$205k - $250k

Lightning AI is seeking AI Platform Support Engineers to join their EMEA Customer Experience team in London. This role focuses on supporting ML engineers who manage large-scale AI training and inference workloads on cloud infrastructure, Kubernetes, and GPU platforms. You will act as a technical partner, diagnosing failures, enhancing reliability, and guiding customers through complex distributed systems challenges. The work involves a wide range of issues, from Kubernetes scheduling and GPU orchestration to distributed PyTorch failures, inference latency, and networking bottlenecks. You will gain exposure to diverse AI workloads across industries and contribute to shaping the infrastructure for next-generation ML applications.

£75k - £95k

Sierra

Sierra is seeking a Software Engineer for its Inference team to build the systems that power their AI agents. This role focuses on making foundation models fast, reliable, and efficient at scale. You will define the inference architecture, working on systems for serving, routing, capacity management, and optimization for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI, requiring strong distributed systems fundamentals and experience with complex systems problems.

$230k - $390k

Baseten

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

Runpod

Runpod is seeking a systems-focused Cloud Infrastructure Security Engineer to safeguard its bare-metal and virtualized GPU cloud infrastructure. This role is crucial for ensuring the security, multi-tenant isolation, and integrity of the underlying GPU cloud infrastructure. The ideal candidate will have deep knowledge of Linux systems, kernel internals, hypervisors, and containerization, focusing on preventing tenant breakouts, securing GPU hardware, and building resilient infrastructure for AI and machine learning workloads. You will operate with an attacker's mindset, identifying and patching vulnerabilities at the lowest levels of the stack.

$152k - $175k