AI Infrastructure Engineer Jobs

Cerebras

Cerebras Systems is seeking a Software Engineer to design and build the core software powering their engineering infrastructure. This role involves working on Python frameworks, orchestration systems, distributed execution, scheduling, test infrastructure, and developer tooling. The ideal candidate enjoys dissecting unfamiliar code, understanding system interdependencies, tackling complex debugging challenges, and improving underlying designs rather than implementing quick fixes. The team values strong software engineering fundamentals, independent problem-solving, and sound systems thinking.

Salary not listed

Cerebras

We are seeking a highly technical, hands-on software engineer to join our Kernel Reliability team. This role focuses on improving the reliability of our advanced compute clusters and the underlying inference, training, and internal production services. You will work closely with the code, designing scalable solutions for our rapidly growing system production and software service offerings. If you have strong fundamentals in systems, debugging, and failure analysis, and enjoy building tools and solving complex reliability problems, we encourage you to apply. New college graduates are welcome.

Salary not listed

NVIDIA is seeking a senior software engineer to design and develop an internal advanced AI-networking simulation service. This service is crucial for improving NVIDIA's AI system offerings, influencing hardware and software design, network architecture, and performance optimization. The role involves enhancing the simulator's performance, quality, and scalability to support massive loads and diverse use cases, while integrating it with cloud computation services to make it available to AI agents and internal customers. If you are passionate about complex challenges and comprehensive software solutions, we encourage you to apply.

Salary not listed

OpenAI

We are seeking an AI Systems Engineer to join our pAGI Infra team, which builds and operates the systems essential for large-scale model training and evaluation. This role involves owning projects from identifying bottlenecks and designing solutions to deployment and operation, focusing on distributed systems engineering, performance optimization, and collaboration with researchers. You will directly contribute to improving the speed and reliability of research by potentially building shared grading services, optimizing resource allocation, or integrating new training stacks into production.

$266k - $500k

Ambient.ai

Ambient.ai is seeking an AI Infrastructure Software Engineer to design, build, and optimize the AI infrastructure powering their real-time intelligence platform. This role involves working on systems to run state-of-the-art deep learning models, including computer vision, large language models (LLMs), large vision models (LVMs), and multimodal AI systems, across vast amounts of video data in real time. You will focus on scaling infrastructure for inference, evaluation, and continuous model improvement, partnering closely with research scientists and product engineering teams to bring AI advancements into production.

$168k - $205k

OpenAI

We are seeking a Software Engineer to develop the research infrastructure and tooling that will enable OpenAI models to design silicon. This role involves transforming chip-design workflows into robust environments for reinforcement learning and evaluation, and simplifying the process for researchers to conduct experiments and iterate on new ideas. You will bridge software engineering, tool integration, and open research challenges, leveraging strong coding fundamentals, clear technical judgment, and independent execution. While prior chip-design experience is beneficial, domain knowledge can be acquired alongside our hardware specialists.

$266k - $468k

Fireworks is seeking PhD graduates in Computer Science, Computer Engineering, or Electrical Engineering to join their Systems Infrastructure team. This role is for individuals who want to apply their research ideas to real-world, large-scale AI infrastructure. You will be responsible for designing and building the core systems that power Fireworks' AI platform, including schedulers, storage systems, and networks, ensuring efficient utilization of hardware and low inference latency. You will work on challenging problems related to compute placement, efficient data movement, and high-performance networking for AI workloads, with the opportunity to see your work ship in a production environment.

$200k - $230k

Manifold is seeking a Staff Software Engineer to join its Core Platform team, a senior group responsible for the foundational services powering the company's data, compute, and workflow capabilities. In this hands-on, individual contributor role, you will work on compute infrastructure, workflow orchestration, data pipelines, platform APIs, and MCP services. You will support enterprise users and their AI agents analyzing large-scale genomics and life sciences datasets. The role offers an opportunity to shape the longer-term product architecture and contribute to core services critical for accelerating the delivery of life-changing medicines to patients.

$170k - $220k

NVIDIA's Site Reliability Engineering (SRE) team is seeking a Principal SRE to shape the technical direction of the company's AI Platform Runtime. This role involves leading reliability engineering initiatives across multiple organizations, solving complex enterprise-scale problems, and establishing architectural standards for critical AI-powered services. The Principal SRE will also drive the adoption of AI agents and skills to enhance platform operations and developer productivity. The team values intellectual curiosity, diversity, collaboration, and continuous learning through blameless analysis, encouraging bold thinking and impactful improvements.

Salary not listed

Cerebras

Cerebras Systems is seeking a Distributed Software Engineer to join their Cluster Engineering team. This team is responsible for the software that manages thousands of wafers, servers, and switches, transforming them into a reliable, efficient, and observable cloud for AI workloads. The role involves building and operating the software stack, which is primarily Go and Python on Kubernetes, for both on-premise deployments and Cerebras's own cloud. The goal is to ensure clusters are stable, workloads are scheduled effectively, and the system is observable to users, operators, and AI agents.

Salary not listed

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team operates with intensity, ownership, and a commitment to excellence, valuing decisiveness, simplicity, and continuous improvement. If you are driven to do your best work alongside like-minded individuals, Harvey is the place to be.

$231k - $340k

Salesforce is seeking an experienced Senior Engineering Manager to lead the Foundations team, which is responsible for the core infrastructure and platform that all other engineering teams build upon. This role involves growing the team from 7 to 12 engineers, driving improvements in delivery, reliability, and technical direction. The ideal candidate will combine deep expertise in platform and infrastructure with strong people leadership, operational rigor, and a proactive approach. This is a high-visibility role focused on shaping the reliability, scalability, and velocity of the entire engineering organization within a high-growth, AI-focused environment.

$173k - $260k

Cerebras

Cerebras Systems is seeking a Senior Software Engineer to build and operate the platform layer behind their engineering infrastructure. This role focuses on designing, building, and maintaining CI/CD systems, Kubernetes-based platforms, and deployment automation. You will work on cloud and on-premises infrastructure, developer environments, artifact management, and observability, ensuring these systems are reliable, scalable, and easy to operate. This is an engineering-focused role where you will automate repetitive tasks, debug complex issues across system boundaries, and drive durable software and platform improvements.

Salary not listed

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

$320k - $485k

Perplexity AI

Perplexity is seeking a Technical Program Manager to act as the central point of contact between our model providers, engineering, and product teams, driving the advancement of our core inference platform. This role is crucial for managing one of the industry's highest-throughput inference stacks, serving diverse traffic across a dynamic portfolio of models. You will operate at the nexus of product, engineering, and finance, coordinating the smooth integration of new models and capacity while executing the roadmap for the inference platform itself. The ideal candidate possesses strong technical acumen, excels at coordinating diverse teams and external partners with competing deadlines, and is motivated by establishing operating models for functions with limited precedent.

$170k - $265k

Anthropic

Anthropic is building reliable, interpretable, and steerable AI systems to be safe and beneficial for users and society. This role leads a team of engineers focused on the critical control plane for Anthropic's inference fleet. This involves making key decisions about request routing and capacity allocation to meet throughput, reliability, and latency goals. The team designs placement and load-balancing algorithms, builds quantitative models for demand and performance, and optimizes latency across various system boundaries. The Engineering Manager will guide a team of ML platform, infrastructure, and distributed systems engineers, ensuring the efficiency, reliability, and evolution of the entire request-to-model path.

$405k - $625k