AI Infrastructure Engineer Jobs

Percepta

Percepta is seeking an AI Infrastructure Engineer to take ownership of the infrastructure, deployment, and operational reliability for Percepta's AI systems, including autonomous agents. This role involves hardening existing infrastructure, strengthening deployment pipelines, and defining new SRE practices for operating autonomous systems. You will be instrumental in bridging the gap between AI research and production, contributing to the foundational decisions that shape the future of agentic infrastructure.

$180k - $400k

Code Metal

Code Metal is seeking a Staff AI Platform Engineer to architect and build the foundational AI enablement stack that internal engineering teams rely on. This role involves designing and operating production systems for GPU inference serving, model gateways, agent harnesses, context management, and observability. While primarily an engineering role focused on building and operating production systems, it also requires solid data science and AI research fundamentals to work closely with the AI Research team and conduct experiments when necessary. The platform is built to product standards, ensuring reliability and scalability for AI-driven code transpilation, modernization, optimization, modeling, and simulation solutions.

$205k - $250k

GM is seeking a Senior Performance Engineer to join the AV Capacity and Performance Engineering team within the AV Infrastructure organization. This role is critical in supporting the development of autonomous vehicles by providing input into large-scale ML infrastructure strategy, advising on cloud budget decisions, identifying and executing optimization projects, and offering capacity planning and engineering expertise. The team's mission is to ensure efficient and scalable ML infrastructure for GM's autonomous vehicle research and development.

$145k - $261k

Capital One is seeking a Director of AI Engineering to lead the development of responsible and reliable AI systems that are transforming the banking industry. This role involves overseeing the design, development, and operation of a platform that enables scientists and engineers to train, fine-tune, and experiment with foundation models at scale. You will be instrumental in shaping the future of AI at Capital One by driving innovation, ensuring scalability, and fostering a culture of learning and technical excellence. This position offers the opportunity to reimagine how we serve customers and businesses through the transformative power of emerging AI capabilities.

$245k - $279k

Mastercard's Operational Intelligence team is developing advanced data products and AI solutions to provide customers with novel ways to access and utilize operational insights. As AI agents transition from proof-of-concept to production, their real-time behavior, including context retrieval, skill selection, and exception handling, continuously evolves. These agents learn from production outcomes, necessitating active management of their reliability, safety, and trustworthiness beyond simple monitoring. This is the domain of AI Ops: ensuring agents' reasoning remains accurate, their context is up-to-date, and their behavior is governed as they learn.

Sierra

Sierra is seeking a Software Engineer for its Inference team to build the systems that power their AI agents. This role focuses on making foundation models fast, reliable, and efficient at scale. You will define the inference architecture, working on systems for serving, routing, capacity management, and optimization for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI, requiring strong distributed systems fundamentals and experience with complex systems problems.

$230k - $390k

Baseten

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

Runpod

Runpod is seeking a systems-focused Cloud Infrastructure Security Engineer to safeguard its bare-metal and virtualized GPU cloud infrastructure. This role is crucial for ensuring the security, multi-tenant isolation, and integrity of the underlying GPU cloud infrastructure. The ideal candidate will have deep knowledge of Linux systems, kernel internals, hypervisors, and containerization, focusing on preventing tenant breakouts, securing GPU hardware, and building resilient infrastructure for AI and machine learning workloads. You will operate with an attacker's mindset, identifying and patching vulnerabilities at the lowest levels of the stack.

$152k - $175k

Modal is building a new infrastructure layer for AI, focusing on the demands of AI workloads that previous infrastructure couldn't support. Our platform provides instant GPU access, sub-second container starts, and native storage, enabling customers to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We are experiencing rapid growth, with a significant increase in annualized run rate and a recent Series D funding round. Our team comprises experienced engineers and researchers from diverse backgrounds, including creators of popular open-source projects and academic researchers.

$220k - $300k

Tenstorrent is seeking a Workload Performance Optimization Engineer to enhance the performance of software workloads on next-generation RISC-V platforms. This role involves optimizing modern datacenter and agentic AI workloads across various programming languages like Java, Python, and Rust. You will identify performance bottlenecks and develop optimizations at the software, compiler, runtime, and hardware levels to improve throughput, latency, and efficiency. The position bridges software runtimes, compilers, CPU microarchitecture, and RISC-V silicon, requiring profiling of real-world applications, investigating memory and concurrency, and leveraging RISC-V capabilities. You will also contribute to AI-assisted development and automated optimization workflows, directly impacting the RISC-V software ecosystem and future CPU architectures.

$100k - $500k

General Motors (GM) is driving the future of mobility with advanced self-driving and electric vehicle technologies. The AV ML Infra team builds ML infrastructure to support AI and ML innovation across various teams, enabling scalable ML experimentation and enhancing ML engineer productivity. This Principal AI/ML Engineer role will lead the AV ML Infra team, shaping long-term vision and execution strategies for GM's AI and ML efforts. The focus is on developing infrastructure products that empower teams to perform machine learning and data science at scale, rather than applying ML models for specific tasks.

$276k - $341k

Wayve's AI Enablement team builds the shared platforms that enable employees across the company to use language models and AI agents safely, reliably, and cost-effectively. As an early member of this platform team, you will help shape both the technical foundations and the standards for how AI-powered tools are built and operated across Wayve. You will design, build, and operate infrastructure for model access, agent runtimes, and observability. You will take projects from initial problem definition through technical design, deployment, and ongoing operation, partnering closely with security, IT, and engineering teams. You will also support teams adopting the platform by troubleshooting issues, documenting reusable patterns, and helping people understand what's possible with the tools available.

Cerebras

Cerebras Systems is seeking a senior software engineer to build and scale the platforms and tools used to monitor and manage its growing fleet of AI clusters across multiple data centers. This role involves owning substantial engineering work across backend services, operational tools, and user-facing applications. You will collaborate with various teams, including Cluster Operations, infrastructure, inference, security, and data center teams, to translate operational challenges into reliable, scalable software solutions. The goal is to ensure fleet health, efficient issue response, and continuous compute capacity availability.

JPMorgan Chase & Co. is seeking an AI Platform Engineer – Vice President to join the Global Technology Applied Research (GTAR) center. This role will engineer, operate, and evolve the shared platforms that enable researchers to develop, evaluate, and mature AI solutions in secure, scalable, firm-approved environments. You will own the cloud and compute foundation for AI research workloads, build reusable platform services and automation, and partner with researchers and enterprise technology teams to ensure experimentation is reproducible, reliable, well-controlled, and ready for downstream integration.

Faire is a technology wholesale platform connecting independent retailers globally. We are seeking a Staff Engineer to own and evolve our data plumbing, ensuring data is accessible, accurate, and queryable for various teams including Product Engineering, Data Science, and Machine Learning. This hands-on role involves designing and building the next generation of our data ingestion and processing systems, and serving as the go-to expert for data movement at Faire.

$247k - $339k

Anthropic

Our Sandboxing team builds the isolation layer that enables Claude to run code, use computers, or act as an agent. These systems are critical for executing code written by Claude for users, training and evaluating models, and supporting customer-deployed agents. The sandboxes must start rapidly, withstand adversarial code, and scale to handle numerous concurrent sessions. This role involves working at the intersection of the Linux kernel, virtualization, and container technologies, collaborating with research, product, and security teams to ensure both safety and performance.

$320k - $485k

Join us as we build the next generation of enterprise search infrastructure powering AI agents. Our mission is to evolve from traditional product-specific search systems into a composable, agent-native platform that enables agents and applications to discover, retrieve, reason over, and recommend information across heterogeneous enterprise data sources. As a Senior Staff Engineer, you will be the technical owner for foundational search infrastructure that serves as the backbone of our agentic platform. You will drive the architecture, scalability, and evolution of core indexing and retrieval systems while partnering closely with Search Ranking, ML, Platform, and AI teams to deliver production-grade search capabilities that power agent experiences across the company.

$191k - $334k

SpaceXAI is seeking an engineer to join our RL infrastructure team and help develop our evaluation infrastructure. This role involves building highly reliable, efficient, and user-friendly systems to run evaluations at scale. You will collaborate with modeling and evaluation teams to develop new evaluations, maintain signal quality, and create internal tooling for training next-generation models. A key part of this role is identifying and resolving performance bottlenecks across the entire evaluation infrastructure stack, including inference, capacity fleet management, and asynchronous evaluation orchestration.

$180k - $440k

We are expanding our research and development for deep learning and are seeking excellent Software Engineers to join our team. We specialize in developing GPU-accelerated deep learning software, enabling breakthroughs in numerous areas. Join the team that builds software to enable new solutions. Your ability to work in a fast-paced, customer-oriented team is required, and excellent communication skills are necessary.

d-Matrix

d-Matrix is seeking a Sr Staff Site Reliability Engineer to join their AI Infrastructure team. This role is crucial for owning the infrastructure layer that powers all engineering teams and customers, encompassing colocation facilities, on-premises GPU clusters, cloud environments, and platform services. You will be responsible for reliability, automation, and observability across these diverse environments, managing systems end-to-end from provisioning to incident response. This is a hands-on position focused on building and operating real infrastructure, collaborating with hardware and software teams on CI/CD, QA, and HPC workloads, and supporting customer-facing deployments.

$175k - $265k

NVIDIA is seeking a Senior System Software Architect specializing in AI and GPU Networking to join their AI Networking Research team. This role involves exploring technological challenges in accelerated networking and building AI data centers, researching new transport functions and semantics for optimizing AI workloads and systems, and leading architectural and development efforts across various fields including distributed AI, deep learning, data analytics, High Performance Computing (HPC), Software Defined Networking (SDN), virtualization, and storage. The architect will enhance NVIDIA's GPU Networking offerings, co-design hardware features to accelerate data movement for inference and model serving, identify and evaluate new technologies, and lead the architecture and design of new innovations like runtime systems and communication libraries.

Anthropic

Anthropic is building reliable, interpretable, and steerable AI systems to be safe and beneficial for users and society. The Cloud Inference team is responsible for scaling and optimizing Claude to serve massive audiences across AWS, GCP, Azure, and other cloud providers. This involves owning the end-to-end product on each platform, from API integration and intelligent request routing to inference execution, capacity management, and operations. Engineers on this team are highly leveraged, driving multiple revenue streams while optimizing compute resources. The role requires product-minded backend engineers who can navigate platform differences, design cross-provider services and abstractions, and make architectural decisions for reliability and cost-effectiveness at massive scale. The work directly contributes to increasing service scale, accelerating the launch of new models and features, and ensuring LLMs meet rigorous safety, performance, and security standards.

$320k - $485k

Anthropic

The Cloud Inference team is responsible for scaling and optimizing Claude to serve massive audiences of developers and enterprise companies across major cloud platforms like AWS, GCP, and Azure. Within this team, the model & inference launch team focuses on the validation pipeline for inference servers and load balancers. This critical infrastructure work ensures that every inference change, including new model launches and performance improvements, is deployed with correctness, performance, and reliability. The goal is to make validation fast, cost-effective, and trustworthy, directly impacting how quickly advanced models and features reach users on all cloud platforms and how efficiently compute resources are utilized.

$320k - $485k

HeyGen is building AI applications including Avatar IV, Photo Avatar, Interactive Avatar, and Video Translation. We are looking for a Software Engineer focused on GPU performance to make the systems behind these experiences faster and more efficient. You will work across model execution and inference infrastructure, using profiling and measurement to improve latency, throughput, and GPU cost. This role is a fit for an engineer who enjoys understanding how software uses the hardware beneath it.