Senior AI Infrastructure Engineer Jobs

Together AI

Together AI is seeking an AI Infrastructure Engineer (SRE) to ensure the smooth operation of user-facing services and production systems. This role combines the skills of a pragmatic operator and a software engineer, applying sound engineering principles, operational discipline, and automation to our operating environments and codebase. You will specialize in systems such as operating systems, storage subsystems, and networking, while implementing best practices for availability, reliability, and scalability, with interests in algorithms and distributed systems. Join a research-driven artificial intelligence company focused on advancing AI through open and transparent systems, aiming to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models.

Salary not listed

MatX is building custom silicon and co-designing hardware/software to make the world's best AI models run with unprecedented efficiency. The AI tooling team plays a crucial role across the entire stack, developing agent harnesses and shared workflows that optimize general-purpose coding agents for specific layers. This position focuses on building the infrastructure that enhances AI agent judgment by providing them with necessary context and verification capabilities. You will work on making agents first-class users of our infrastructure, building secure execution environments, and developing a company-wide agent knowledge base. This is an opportunity to have a significant impact at a growing company where your work will directly influence every engineer using AI agents.

$160k - $275k

As a Senior Lead Software Engineer on the Firmwide AI/ML Deployment Platform team, you will be a key part of a globally distributed team responsible for architecting, building, and owning the infrastructure that enables model deployment at scale. You will have significant autonomy, driving technical direction, engaging directly with clients, and making critical architectural decisions. The team builds the control plane, APIs, monitoring, and deployment infrastructure that internal teams rely on, constantly evolving to meet new scale requirements and challenges. This role is ideal for someone who enjoys owning problems end-to-end, making difficult tradeoffs, and shipping systems that empower other engineers.

Salary not listed

At WRITER, our mission to expand human capacity with superintelligence relies on a foundational truth: our platform must be available, performant, and reliable, 24/7. As an Infrastructure engineer, you'll be at the heart of making this a reality, impacting every enterprise customer who trusts us with their AI-powered workflows. This isn't just about keeping the lights on; it's about pushing the boundaries of what's possible, proactively identifying and solving complex systemic challenges, and laying the groundwork for our rapid growth and the evolving demands of enterprise generative AI. You'll build resilient systems, automate across the stack, and champion reliability best practices, directly enabling our ambitious product roadmap and ensuring our customers always have access to the powerful tools they need.

$155k - $240k

AssemblyAI

AssemblyAI is seeking a Software Engineer to bridge the gap between cutting-edge AI research and production-ready products. You will join a dynamic engineering team responsible for transforming new model capabilities from initial concepts into robust, well-documented APIs that handle production traffic at scale. This role involves designing and launching customer-facing APIs, scaling inference infrastructure, and collaborating with researchers and customers to ensure our products meet user needs and drive future development.

$190k - $225k

MatX is building the compute platform for AGI, developing vertically integrated full-stack solutions from silicon to systems. We are seeking a hands-on engineering lead to manage, mentor, and grow a team of kernel engineers while setting technical direction and executing. This role involves actively contributing to the design and implementation of high-performance compute kernels for specialized AI hardware, partnering with ML teams to maximize output and improve diagnostics, and collaborating with hardware teams to co-design next-generation AI architectures.

$160k - $275k

Anthropic

The Safeguards ML Infra team is responsible for designing, building, and operating the production infrastructure that powers Claude's safety systems. This role is central to ensuring safeguards are properly configured and deployed for model launches, and owning the off-cycle deployment of new safety classifiers. The team ensures safety on the token generation path and manages the operational aspects of deploying these systems into production, including standing up safeguards for new model launches and deploying new safety classifiers. Every frontier model release goes through this team, which configures, verifies, and rolls out safeguards across all Claude platforms and leads incident response when issues arise. The goal is to automate manual checks into continuous validation and evolve launch runbooks into robust tooling.

$320k - $485k

Databricks

Databricks is seeking a Staff Software Engineer to join their AI Research Infrastructure team. In this role, you will be responsible for developing and operating the research stack that powers Databricks' AI research efforts. You will design and build services for scheduling, orchestrating, and observing large-scale training and inference experiment workloads across thousands of GPUs. Your work will involve improving developer tooling to ensure researchers can iterate quickly while maintaining reliability, efficiency, and security. You will collaborate closely with research scientists, ML engineers, and platform teams to transform experimental workloads into robust, repeatable pipelines and push the boundaries of the infrastructure's capabilities.

$199k - $270k

Databricks

At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems. We build and run the world's best data and AI infrastructure platform. As part of the AI Platform team, you'll build the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search. You'll be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses helping thousands of our customers democratize AI within their organizations. We’re building the infrastructure that powers the next generation of AI.

$165k - $220k

We are seeking an experienced software engineer to contribute to the CUDA driver, a fundamental component of NVIDIA's CUDA parallel computing platform. This role involves designing and implementing innovative solutions within critical system software for NVIDIA Tegra platforms. The ideal candidate will be a highly motivated individual looking to grow their career in a fast-paced, innovative environment, capable of prioritizing effectively, communicating clearly, and managing multiple project aspects with agility.

Salary not listed

Assume a critical role in defining the future of a globally recognized firm and have a direct and significant effect in a realm tailored for top achievers in site reliability. As a Lead Site Reliability Engineer within the AI Machine Learning and Data platform team, you will hold a leadership role, demonstrate strong knowledge across multiple technical domains, and advise others on technical and business issues. You will take the lead in conducting resiliency design reviews, break down complex problems into digestible work for other engineers, act as a technical lead for medium to large-sized products, and provide advice and mentoring to other engineers.

Salary not listed

Anthropic

Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence. Our mission is to ensure that transformative AI systems are aligned with human interests. We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models. In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems.

$500k - $850k

Modal is building the next-generation infrastructure layer for AI, enabling companies to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. Our platform provides instant GPU access, sub-second container starts, and native storage, supporting category-defining customers. We are seeking a leader to own the direction and execution of our LLM inference platform, a critical component of our offering that delivers frontier performance with best-in-class elasticity and developer experience. This is a hands-on leadership role where you will split your time between technical contributions, product shaping, and people management, setting direction, removing blockers, and fostering a strong engineering culture.

$300k - $350k

Anthropic

We are seeking software engineers to join our Safeguards team, focusing on building robust safety and oversight mechanisms for our AI systems. This role involves developing distributed and scalable systems to monitor models, prevent misuse, and ensure user well-being. You will work to detect unwanted model behaviors and prevent disallowed use, applying your technical skills to uphold principles of safety, transparency, and oversight while enforcing terms of service and acceptable use policies.

$320k - $485k

Fin, now part of Salesforce, is seeking Senior+ AI Infrastructure Engineers to build the systems that train and serve their next generation of AI products. Fin is an AI company that builds from the GPU all the way up to a user agent that resolves millions of customer service queries a month. You'll join a small, highly technical team working at the cutting edge of modern AI infrastructure, responsible for training pipelines and inference for custom models. The AI Infra team built the training pipelines and runs the inference for custom models like Fin Apex, which outperforms frontier models in customer service tasks, and is the foundation of the AI Group's full stack approach to AI.

Salary not listed

NVIDIA is seeking a senior software engineer to design and develop an internal advanced AI-networking simulation service. This service is crucial for improving NVIDIA's AI system offerings, influencing hardware and software design, network architecture, and performance optimization. The role involves enhancing the simulator's performance, quality, and scalability to support massive loads and diverse use cases, while integrating it with cloud computation services to make it available to AI agents and internal customers. If you are passionate about complex challenges and comprehensive software solutions, we encourage you to apply.

Salary not listed

Manifold is seeking a Staff Software Engineer to join its Core Platform team, a senior group responsible for the foundational services powering the company's data, compute, and workflow capabilities. In this hands-on, individual contributor role, you will work on compute infrastructure, workflow orchestration, data pipelines, platform APIs, and MCP services. You will support enterprise users and their AI agents analyzing large-scale genomics and life sciences datasets. The role offers an opportunity to shape the longer-term product architecture and contribute to core services critical for accelerating the delivery of life-changing medicines to patients.

$170k - $220k

NVIDIA's Site Reliability Engineering (SRE) team is seeking a Principal SRE to shape the technical direction of the company's AI Platform Runtime. This role involves leading reliability engineering initiatives across multiple organizations, solving complex enterprise-scale problems, and establishing architectural standards for critical AI-powered services. The Principal SRE will also drive the adoption of AI agents and skills to enhance platform operations and developer productivity. The team values intellectual curiosity, diversity, collaboration, and continuous learning through blameless analysis, encouraging bold thinking and impactful improvements.

Salary not listed

Cerebras

Cerebras Systems is seeking a Distributed Software Engineer to join their Cluster Engineering team. This team is responsible for the software that manages thousands of wafers, servers, and switches, transforming them into a reliable, efficient, and observable cloud for AI workloads. The role involves building and operating the software stack, which is primarily Go and Python on Kubernetes, for both on-premise deployments and Cerebras's own cloud. The goal is to ensure clusters are stable, workloads are scheduled effectively, and the system is observable to users, operators, and AI agents.

Salary not listed

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team operates with intensity, ownership, and a commitment to excellence, valuing decisiveness, simplicity, and continuous improvement. If you are driven to do your best work alongside like-minded individuals, Harvey is the place to be.

$231k - $340k

Salesforce is seeking an experienced Senior Engineering Manager to lead the Foundations team, which is responsible for the core infrastructure and platform that all other engineering teams build upon. This role involves growing the team from 7 to 12 engineers, driving improvements in delivery, reliability, and technical direction. The ideal candidate will combine deep expertise in platform and infrastructure with strong people leadership, operational rigor, and a proactive approach. This is a high-visibility role focused on shaping the reliability, scalability, and velocity of the entire engineering organization within a high-growth, AI-focused environment.

$173k - $260k

Cerebras

Cerebras Systems is seeking a Senior Software Engineer to build and operate the platform layer behind their engineering infrastructure. This role focuses on designing, building, and maintaining CI/CD systems, Kubernetes-based platforms, and deployment automation. You will work on cloud and on-premises infrastructure, developer environments, artifact management, and observability, ensuring these systems are reliable, scalable, and easy to operate. This is an engineering-focused role where you will automate repetitive tasks, debug complex issues across system boundaries, and drive durable software and platform improvements.

Salary not listed

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

$320k - $485k

Perplexity AI

Perplexity is seeking a Technical Program Manager to act as the central point of contact between our model providers, engineering, and product teams, driving the advancement of our core inference platform. This role is crucial for managing one of the industry's highest-throughput inference stacks, serving diverse traffic across a dynamic portfolio of models. You will operate at the nexus of product, engineering, and finance, coordinating the smooth integration of new models and capacity while executing the roadmap for the inference platform itself. The ideal candidate possesses strong technical acumen, excels at coordinating diverse teams and external partners with competing deadlines, and is motivated by establishing operating models for functions with limited precedent.

$170k - $265k