Senior AI Infrastructure Engineer Jobs

Code Metal

Code Metal is seeking a Senior Software Engineer for its AI Platform team. This role involves designing, building, and operating the foundational AI enablement stack that powers the company's AI-driven code solutions. You will contribute to critical components such as GPU inference serving, model gateways, agent harnesses, context engineering, observability, and AI experimentation management. While this is an internal platform, it is built to product standards. The position offers the opportunity to eventually own a specific area, like model serving or agentic infrastructure, while also contributing broadly across the stack. The role requires a blend of strong software engineering skills with solid data science and AI research fundamentals, including occasional experimental work to inform platform decisions.

$170k - $210k

FAR.AI is seeking a Tech Lead Manager for its GPU Cluster Infrastructure team. This role involves leading a sub-team focused on managing and scaling the organization's GPU compute platform, which supports cutting-edge AI safety research. You will be responsible for the technical direction and roadmap of the platform, ensuring its performance, fault tolerance, and security, especially as AI agents increasingly utilize the cluster for experiments. This position requires a blend of technical expertise and leadership, with at least half of your time dedicated to hands-on engineering work. You will also be responsible for hiring and growing the infrastructure team, setting priorities, and providing mentorship.

$225k - $325k

Relevance AI is building the future of the AI workforce, empowering teams to delegate meaningful work to intelligent AI agents. Our platform enables the creation and management of agents that handle complex workflows and decisions, already used by industry leaders. We are backed by prominent investors and have secured Series B funding to accelerate growth. Headquartered in San Francisco and Sydney, we operate on a hybrid model focused on curiosity, collaboration, and execution. This role is crucial for building the factory that ships every feature, focusing on an end-to-end system where coding agents can pick up, build, test, review, and deploy tasks safely and at speed. You will own the developer experience, platform infrastructure, and reliability, shaping the foundations of our AI-native platform and multiplying the output of every engineer and agent.

Salary not listed

We are seeking a Senior Technical Support Engineer with deep expertise in Ethernet networking and AI infrastructure. In this customer-facing role, you will own complex technical investigations and critical escalations involving large-scale data center and AI environments. You will serve as a trusted technical advisor to strategic customers, combining strong troubleshooting skills with excellent communication, crisis management, and technical leadership. You will collaborate closely with Engineering, Product Management, Marketing, and Support teams to resolve issues and improve our products and support practices.

Salary not listed

FAR.AI is seeking a Senior Software Engineer to join their Foundations team, which is responsible for the institute's compute platform, research tools, and workflow automation. This role will focus on accelerating AI safety research by managing and scaling the GPU cluster fleet, which includes bare-metal and managed Kubernetes environments. The engineer will work directly with researchers and other engineers to ensure large-scale experiments are performant and fault-tolerant, contributing to the core infrastructure that enables cutting-edge AI safety advancements.

$150k - $275k

Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.

$195k - $395k

Join a technology team where your engineering leadership directly improves customer and colleague experiences through resilient, secure, cloud-enabled products. As a Senior Lead Software Engineer, you will drive meaningful outcomes by building and evolving secure, scalable platforms and services. You will apply deep technical expertise and leadership to solve complex engineering problems, accelerate cloud adoption, and raise the quality bar through strong design and engineering practices. This role is based in Columbus, Ohio.

Salary not listed

Lovable is seeking an infrastructure engineer to build the data ingestion, storage, and query systems that power their agentic software creation platform. This role is crucial for ensuring the reliability of data for applications built on Lovable. The company is a fast-growing AI company based in Stockholm, with a culture of ownership, velocity, and collaboration. They are looking for individuals who are passionate about making a significant impact in the next era of software development.

Salary not listed

NVIDIA is seeking a highly skilled and motivated Senior CUDA Test Development Software Engineer to join our CUDA Test Development team in Shanghai, China. This team is responsible for all aspects of quality assurance for CUDA products, including regression testing, release testing, test automation, and test development, ensuring the highest quality standards. We are looking for individuals passionate about AI computing and working with brilliant technical people across countries.

Salary not listed

Lambda, The Superintelligence Cloud, is seeking a Senior Systems Engineer to join their Enterprise AI Platforms team. This role focuses on building and scaling the internal systems that power Lambda's business, partnering across departments to implement tools, automate workflows, and ensure data integrity. You will be instrumental in designing, developing, and deploying software and services to enhance the availability, scalability, reliability, and efficiency of Lambda’s internal IT systems and platforms. The position requires a proactive approach to problem-solving, automation, and influencing the creation of new architectures for large-scale distributed systems, with a strong emphasis on AI infrastructure and tooling.

$206k - $275k

Anthropic

Anthropic's Environments organization is responsible for building and maintaining the infrastructure that enhances Claude's capabilities through reinforcement learning. This includes developing frameworks for researchers to build environments and the underlying infrastructure for running them, with a core mission to productionize research. The role involves embedding with research teams to understand their workflows and designing frameworks and APIs that accelerate their progress, ensuring these systems are understandable, ownable, and maintainable. A significant part of the role also includes ensuring the health, maintainability, monitoring, and ease of triage for production RL runs. The ideal candidate will possess deep Python expertise, a strong sense of API and framework design, and an intuitive understanding of complex system failures, particularly silent ones. Experience with stateful distributed systems like workflow engines or actor frameworks is a plus. The role requires comfort in navigating and abstracting complex research codebases, incrementally improving them while research continues, and leveraging AI tools for development with a focus on verification.

$405k - $605k

Lightning AI is seeking an experienced Senior GPU & Compute Infrastructure Engineer to join their Infrastructure Engineering team. This role focuses on bringing up, validating, and operating large-scale bare-metal compute infrastructure, with a strong emphasis on GPU-enabled systems. You will work at the intersection of hardware, systems, and software, owning system diagnostics, validation, automation development, reliability improvements, and ensuring clusters are ready for demanding AI/ML and HPC workloads. The position involves GPU and system-level qualification, running validation environments and test clusters, and enhancing tooling and workflows for infrastructure bring-up at scale, including managing image pipelines and provisioning systems for consistency, performance, and reliability.

$180k - $220k

Crusoe

Crusoe is building the operating system for AI datacenters, managing one of the world's largest GPU fleets. This role focuses on building a unified platform that senses, reasons about, and acts on the entire fleet, moving beyond traditional operational methods to achieve fleet autonomy. The platform is designed as a product with an API-first approach, offering SDKs, paved paths, and a self-serve portal for internal teams. It comprises agents for telemetry and command execution, a distributed infra graph, a reconciliation core for state management, and domain services for various operational tasks. The goal is to create an autonomous system that continuously improves through a sense-correlate-reason-act-learn loop, reducing manual interventions and enabling other teams to build services and workflows efficiently.

$250k - $300k

Baseten

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

Reducto

Reducto is seeking a Software Engineer for its Platform team to own the infrastructure behind the company's core API. This role involves ensuring document understanding systems are fast, reliable, and cost-efficient at scale. You will work across Python services, queues, model-serving, Kubernetes, observability, and developer tooling to enhance the platform's robustness. This is a high-leverage infrastructure position for someone who has built and operated production systems, prioritizes latency, reliability, and cost, and is adept at using modern LLM coding tools.

$200k - $325k

Join our Conversation Engine team to scale and optimize a cutting-edge Generative AI product that provides instant assistance to enterprise users. You will work at the core of Moveworks' Generative AI product, focusing on scaling and optimizing it for the enterprise solution space. We encourage innovative ideas to solve unsolved problems, collaborating closely with machine learning experts and cross-functional teams to rapidly iterate on new ideas and leverage user behavior data. Your challenge will be to scale and optimize our conversation engine to support hundreds of millions of users across multiple chat channels and use cases, enhancing our end-to-end product infrastructure with engineering quality and robustness.

$176k - $308k

Percepta

Percepta is seeking an AI Infrastructure Engineer to take ownership of the infrastructure, deployment, and operational reliability for Percepta's AI systems, including autonomous agents. This role involves hardening existing infrastructure, strengthening deployment pipelines, and defining new SRE practices for operating autonomous systems. You will be instrumental in bridging the gap between AI research and production, contributing to the foundational decisions that shape the future of agentic infrastructure.

$180k - $400k

Databricks

At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems by building and running the world's best data and AI infrastructure platform. As part of the AI Platform team, you will build the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search. You will be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses helping thousands of our customers democratize AI within their organizations, and we are building the infrastructure that powers the next generation of AI.

$166k - $225k

Code Metal

Code Metal is seeking a Staff AI Platform Engineer to architect and build the foundational AI enablement stack that internal engineering teams rely on. This role involves designing and operating production systems for GPU inference serving, model gateways, agent harnesses, context management, and observability. While primarily an engineering role focused on building and operating production systems, it also requires solid data science and AI research fundamentals to work closely with the AI Research team and conduct experiments when necessary. The platform is built to product standards, ensuring reliability and scalability for AI-driven code transpilation, modernization, optimization, modeling, and simulation solutions.

$205k - $250k

Capital One is seeking a Director of AI Engineering to lead the development of responsible and reliable AI systems that are transforming the banking industry. This role involves overseeing the design, development, and operation of a platform that enables scientists and engineers to train, fine-tune, and experiment with foundation models at scale. You will be instrumental in shaping the future of AI at Capital One by driving innovation, ensuring scalability, and fostering a culture of learning and technical excellence. This position offers the opportunity to reimagine how we serve customers and businesses through the transformative power of emerging AI capabilities.

$245k - $279k

GM is seeking a Senior Performance Engineer to join the AV Capacity and Performance Engineering team within the AV Infrastructure organization. This role is critical in supporting the development of autonomous vehicles by providing input into large-scale ML infrastructure strategy, advising on cloud budget decisions, identifying and executing optimization projects, and offering capacity planning and engineering expertise. The team's mission is to ensure efficient and scalable ML infrastructure for GM's autonomous vehicle research and development.

$145k - $261k

Mastercard's Operational Intelligence team is developing advanced data products and AI solutions to provide customers with novel ways to access and utilize operational insights. As AI agents transition from proof-of-concept to production, their real-time behavior, including context retrieval, skill selection, and exception handling, continuously evolves. These agents learn from production outcomes, necessitating active management of their reliability, safety, and trustworthiness beyond simple monitoring. This is the domain of AI Ops: ensuring agents' reasoning remains accurate, their context is up-to-date, and their behavior is governed as they learn.

Salary not listed

Runpod

Runpod is seeking a systems-focused Cloud Infrastructure Security Engineer to safeguard its bare-metal and virtualized GPU cloud infrastructure. This role is crucial for ensuring the security, multi-tenant isolation, and integrity of the underlying GPU cloud infrastructure. The ideal candidate will have deep knowledge of Linux systems, kernel internals, hypervisors, and containerization, focusing on preventing tenant breakouts, securing GPU hardware, and building resilient infrastructure for AI and machine learning workloads. You will operate with an attacker's mindset, identifying and patching vulnerabilities at the lowest levels of the stack.

$152k - $175k

General Motors (GM) is driving the future of mobility with advanced self-driving and electric vehicle technologies. The AV ML Infra team builds ML infrastructure to support AI and ML innovation across various teams, enabling scalable ML experimentation and enhancing ML engineer productivity. This Principal AI/ML Engineer role will lead the AV ML Infra team, shaping long-term vision and execution strategies for GM's AI and ML efforts. The focus is on developing infrastructure products that empower teams to perform machine learning and data science at scale, rather than applying ML models for specific tasks.

$276k - $341k