AI Infrastructure Engineer Jobs

Together AI

At Together AI, you will build and operate one of the world's largest GPU fleets for frontier model training and inference. This role is for engineers who excel at building systems, automating processes, and solving problems at a massive scale. If you prefer writing software over manual operations and aim to build infrastructure that autonomously manages tens of thousands of GPUs, we encourage you to apply.

$190k - $270k

Isomorphic Labs is seeking a Staff Software Engineer to join their Inference Platform team in London. This role is pivotal in ensuring the reliability and scalability of the company's AI infrastructure, which is used to build foundation models for drug discovery. You will play a key part in hardening systems and ensuring the AI infrastructure is stable, reliable, and can handle increasing data volumes and model sizes as the company grows. This is an opportunity to contribute to groundbreaking innovation in applying AI to cure disease within an interdisciplinary team.

Salary not listed

We are seeking an AI Platform Architect to design and evolve the reusable platform capabilities necessary for building, deploying, securing, observing, and scaling AI products across hybrid environments. This role involves defining reference platforms, environment topologies, network patterns, and access controls. You will design model access, compute, storage, vector services, orchestration, gateways, and shared platform services, supporting various deployment choices including cloud, sovereign, edge, and on-premises. A key aspect of this role is defining platform non-functional requirements for availability, performance, resilience, scalability, and cost, while creating reusable landing patterns and platform guardrails for delivery squads. You will also partner with MLOps Engineers on environment automation, observability, and release management.

Salary not listed

NVIDIA is seeking passionate Compute/DL Architecture Performance Optimization Interns to explore computer architectures for deep learning and work at the intersection of hardware and software. The role involves mining the ultimate performance of deep learning operators and designing scalable infrastructure to ship highly optimized operators to NVIDIA's software libraries for training and inference.

Salary not listed

Inference has become a networking challenge, especially with disaggregated serving architectures where different stages of computation (prefill, decode, KV cache streaming) occur on separate GPU sets. Performance hinges on efficient tensor movement between GPUs, nodes, and storage. These elastic deployments require dynamic APIs for managing worker joins/leaves, connection management, and runtime rerouting without pipeline stalls. NIXL (NVIDIA's Inference Xfer Library) addresses these needs, underpinning NVIDIA Dynamo and various inference engines. This role involves working directly with platform teams building demanding inference deployments in China, identifying and resolving scaling issues, and contributing to upstream code and roadmaps. You will collaborate daily with core NIXL and Dynamo engineers across different regions.

Salary not listed

Together AI

As a Customer Support Engineer at Together AI, you will be the primary point of contact for customers building AI solutions, including training, fine-tuning, and inference. You will tackle complex technical challenges, provide expert solutions, and act as a product specialist. This role involves close collaboration with product and sales teams to enhance offerings and drive customer success in a fast-paced, innovative AI environment.

Salary not listed

Together AI

Together AI is seeking an experienced AI Infra (Systems Engineers) Lead/Manager to join our team in Amsterdam. You will be responsible for keeping all user-facing services and production systems running smoothly, blending operational discipline with software engineering principles. This role involves applying sound engineering practices and automation to our operating environments and codebase, with a specialization in systems like operating systems, storage, and networking, while focusing on availability, reliability, and scalability.

Salary not listed

Together AI

Together AI is seeking an AI Infrastructure Engineer (SRE) to ensure the smooth operation of user-facing services and production systems. This role combines the skills of a pragmatic operator and a software engineer, applying sound engineering principles, operational discipline, and automation to our operating environments and codebase. You will specialize in systems such as operating systems, storage subsystems, and networking, while implementing best practices for availability, reliability, and scalability, with interests in algorithms and distributed systems. Join a research-driven artificial intelligence company focused on advancing AI through open and transparent systems, aiming to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models.

Salary not listed

MatX is building custom silicon and co-designing hardware/software to make the world's best AI models run with unprecedented efficiency. The AI tooling team plays a crucial role across the entire stack, developing agent harnesses and shared workflows that optimize general-purpose coding agents for specific layers. This position focuses on building the infrastructure that enhances AI agent judgment by providing them with necessary context and verification capabilities. You will work on making agents first-class users of our infrastructure, building secure execution environments, and developing a company-wide agent knowledge base. This is an opportunity to have a significant impact at a growing company where your work will directly influence every engineer using AI agents.

$160k - $275k

As a Senior Lead Software Engineer on the Firmwide AI/ML Deployment Platform team, you will be a key part of a globally distributed team responsible for architecting, building, and owning the infrastructure that enables model deployment at scale. You will have significant autonomy, driving technical direction, engaging directly with clients, and making critical architectural decisions. The team builds the control plane, APIs, monitoring, and deployment infrastructure that internal teams rely on, constantly evolving to meet new scale requirements and challenges. This role is ideal for someone who enjoys owning problems end-to-end, making difficult tradeoffs, and shipping systems that empower other engineers.

Salary not listed

At WRITER, our mission to expand human capacity with superintelligence relies on a foundational truth: our platform must be available, performant, and reliable, 24/7. As an Infrastructure engineer, you'll be at the heart of making this a reality, impacting every enterprise customer who trusts us with their AI-powered workflows. This isn't just about keeping the lights on; it's about pushing the boundaries of what's possible, proactively identifying and solving complex systemic challenges, and laying the groundwork for our rapid growth and the evolving demands of enterprise generative AI. You'll build resilient systems, automate across the stack, and champion reliability best practices, directly enabling our ambitious product roadmap and ensuring our customers always have access to the powerful tools they need.

$155k - $240k

AssemblyAI

AssemblyAI is seeking a Software Engineer to bridge the gap between cutting-edge AI research and production-ready products. You will join a dynamic engineering team responsible for transforming new model capabilities from initial concepts into robust, well-documented APIs that handle production traffic at scale. This role involves designing and launching customer-facing APIs, scaling inference infrastructure, and collaborating with researchers and customers to ensure our products meet user needs and drive future development.

$190k - $225k

MatX is building the compute platform for AGI, developing vertically integrated full-stack solutions from silicon to systems. We are seeking a hands-on engineering lead to manage, mentor, and grow a team of kernel engineers while setting technical direction and executing. This role involves actively contributing to the design and implementation of high-performance compute kernels for specialized AI hardware, partnering with ML teams to maximize output and improve diagnostics, and collaborating with hardware teams to co-design next-generation AI architectures.

$160k - $275k

Anthropic

The Safeguards ML Infra team is responsible for designing, building, and operating the production infrastructure that powers Claude's safety systems. This role is central to ensuring safeguards are properly configured and deployed for model launches, and owning the off-cycle deployment of new safety classifiers. The team ensures safety on the token generation path and manages the operational aspects of deploying these systems into production, including standing up safeguards for new model launches and deploying new safety classifiers. Every frontier model release goes through this team, which configures, verifies, and rolls out safeguards across all Claude platforms and leads incident response when issues arise. The goal is to automate manual checks into continuous validation and evolve launch runbooks into robust tooling.

$320k - $485k

Databricks

Databricks is seeking a Staff Software Engineer to join their AI Research Infrastructure team. In this role, you will be responsible for developing and operating the research stack that powers Databricks' AI research efforts. You will design and build services for scheduling, orchestrating, and observing large-scale training and inference experiment workloads across thousands of GPUs. Your work will involve improving developer tooling to ensure researchers can iterate quickly while maintaining reliability, efficiency, and security. You will collaborate closely with research scientists, ML engineers, and platform teams to transform experimental workloads into robust, repeatable pipelines and push the boundaries of the infrastructure's capabilities.

$199k - $270k

Databricks

At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems. We build and run the world's best data and AI infrastructure platform. As part of the AI Platform team, you'll build the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search. You'll be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses helping thousands of our customers democratize AI within their organizations. We’re building the infrastructure that powers the next generation of AI.

$165k - $220k

Cerebras

Cerebras Systems is seeking an AI Data Center Infrastructure Engineer to bridge the gap between high-level cluster architecture and practical data center implementation. This role involves defining precise infrastructure designs, including rack layouts, equipment placement, bills of materials, power requirements, and connectivity mapping for compute, network, and storage systems. You will adapt existing designs to specific site constraints while ensuring system performance, reliability, and scalability. Additionally, you will automate design processes through the development of tools, validation checks, and reusable frameworks to enhance deployment speed, accuracy, and operational ease at scale. This position is ideal for an engineer who thrives on detailed systems work, practical problem-solving, and cross-functional collaboration with hardware, networking, software, and data center operations teams.

Salary not listed

We are seeking an experienced software engineer to contribute to the CUDA driver, a fundamental component of NVIDIA's CUDA parallel computing platform. This role involves designing and implementing innovative solutions within critical system software for NVIDIA Tegra platforms. The ideal candidate will be a highly motivated individual looking to grow their career in a fast-paced, innovative environment, capable of prioritizing effectively, communicating clearly, and managing multiple project aspects with agility.

Salary not listed

Assume a critical role in defining the future of a globally recognized firm and have a direct and significant effect in a realm tailored for top achievers in site reliability. As a Lead Site Reliability Engineer within the AI Machine Learning and Data platform team, you will hold a leadership role, demonstrate strong knowledge across multiple technical domains, and advise others on technical and business issues. You will take the lead in conducting resiliency design reviews, break down complex problems into digestible work for other engineers, act as a technical lead for medium to large-sized products, and provide advice and mentoring to other engineers.

Salary not listed

Join NVIDIA’s Cosmos Lab Infrastructure team to develop training and post-training systems for advanced Physical AI models, including world foundation models and robot policies. Our infrastructure connects training, inference, and evaluation with simulation and real-world robot interaction. You will work with a mentor on a focused project scoped to your experience and internship duration, implementing and evaluating systems improvements on real AI workloads using NVIDIA’s GPU infrastructure.

Salary not listed

Anthropic

Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence. Our mission is to ensure that transformative AI systems are aligned with human interests. We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models. In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems.

$500k - $850k

Modal is building the next-generation infrastructure layer for AI, enabling companies to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. Our platform provides instant GPU access, sub-second container starts, and native storage, supporting category-defining customers. We are seeking a leader to own the direction and execution of our LLM inference platform, a critical component of our offering that delivers frontier performance with best-in-class elasticity and developer experience. This is a hands-on leadership role where you will split your time between technical contributions, product shaping, and people management, setting direction, removing blockers, and fostering a strong engineering culture.

$300k - $350k

Anthropic

We are seeking software engineers to join our Safeguards team, focusing on building robust safety and oversight mechanisms for our AI systems. This role involves developing distributed and scalable systems to monitor models, prevent misuse, and ensure user well-being. You will work to detect unwanted model behaviors and prevent disallowed use, applying your technical skills to uphold principles of safety, transparency, and oversight while enforcing terms of service and acceptable use policies.

$320k - $485k

Fin, now part of Salesforce, is seeking Senior+ AI Infrastructure Engineers to build the systems that train and serve their next generation of AI products. Fin is an AI company that builds from the GPU all the way up to a user agent that resolves millions of customer service queries a month. You'll join a small, highly technical team working at the cutting edge of modern AI infrastructure, responsible for training pipelines and inference for custom models. The AI Infra team built the training pipelines and runs the inference for custom models like Fin Apex, which outperforms frontier models in customer service tasks, and is the foundation of the AI Group's full stack approach to AI.

Salary not listed