Distributed Systems Jobs

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry's largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

€235k - €295k

Databricks

Databricks is seeking a Staff Engineer for AI Search to play a critical role in building and scaling their next-generation Search product, encompassing Vector Search, Keyword Search, and Search Quality. The role involves driving the design and evolution of a highly-performant, cost-efficient, and developer-friendly Search stack that enables customers to build AI applications with accuracy, speed, and scale. Beyond hands-on contributions, the engineer will help define the long-term vision, mentor senior engineers, collaborate across teams, and lead strategic efforts to expand the technical and business impact of Search at Databricks.

$166k - $225k

Databricks

Databricks' Model Serving product offers enterprises a unified, scalable, and governed platform for deploying and managing AI/ML models, including traditional ML and large language models. It provides real-time, low-latency inference, governance, monitoring, and lineage, making it a core pillar for customers operationalizing models at scale with strong SLAs and cost efficiency. As a Senior Engineer, you will be instrumental in shaping both the product experience and the foundational infrastructure of Model Serving. You will design and build high-throughput, low-latency inference systems for CPU and GPU workloads, influence architectural direction, and collaborate with cross-functional teams to deliver a world-class serving platform.

$166k - $225k

NVIDIA is seeking strategic, ambitious, hard-working, collaborative, and creative Ph.D. Engineering interns to join their Computer Architecture and Systems teams for Summer 2027. This internship offers an excellent opportunity to expand your career and gain hands-on experience with industry-leading technologies. Interns will design and implement novel ideas in GPU and CPU architectures, systems architectures, operating systems, AI systems, and distributed systems, with the potential to transfer their research to product groups, resulting in prototypes, patents, products, or published research.

$0k - $0k

Join the new Agentic Engineering team, focused on automating code generation, testing, and tuning across NVIDIA's frameworks, compilers, and developer tooling. This is a greenfield opportunity offering foundational technical influence within a high-autonomy team. You will partner directly with early-adopter teams to translate complex requirements into durable, scalable infrastructure, applying modern AI to the craft of engineering itself. The role involves identifying friction points where agentic workflows can have the highest impact and iterating with teams as they integrate agents into production.

$224k - $357k

Physical Intelligence is building a platform to bring general-purpose AI into the physical world, powering robots with foundation models and learning algorithms. As an API Product Engineer, you will develop the core product surface that enables external companies to utilize Pi's models similarly to how they use LLM APIs today. This involves allowing them to bring their own data, fine-tune models, evaluate performance, and run low-latency inference within their own environments. You will own this entire experience, transforming close-knit collaborations into a scalable platform designed to support a vast number of robots.

OpenAI

API Agents is building the shared agent harness, tools, and infrastructure that turn OpenAI’s frontier models into systems capable of reliably completing real work. This role focuses on building the core systems behind the next generation of agents, designing reliable services and abstractions that help agents find context, use tools, retain knowledge, coordinate workflows, and take action safely. The position combines deep backend and infrastructure work with strong product judgment, offering opportunities to work across agent runtimes, orchestration, search, execution environments, identity, observability, and evaluations. Success in this role hinges on strong backend fundamentals, high agency, and the ability to translate fast-moving research into dependable production primitives.

$266k - $445k

Aleph Alpha is seeking a Senior AI Researcher to join their Pre-training team, focusing on advancing the architecture and training of next-generation foundation models. This role involves designing inference-efficient architectures, optimizing large-scale training recipes, and working with thousands of NVIDIA GPUs. The position is ideal for someone excited about the intersection of research and engineering, translating mathematical reasoning into principled training decisions from small-scale experiments to large-scale runs. The researcher will influence model quality, run reliability, and efficiency by combining rigorous experimental design with high-quality production code.

We are seeking an AI Agent & LLM Engineer to join our team and contribute to the AI systems powering Otter’s conversational knowledge engine and AI Chat. This role involves building and enhancing user-facing agent experiences, evaluation systems, and the underlying platform for reliable, large-scale operation. You will translate ambiguous product challenges into production-ready solutions, define quality metrics, and drive improvements across services, models, and user experience.

$155k - $185k

Asana's AI organization is building the platform and products that integrate AI into how teams work. This includes AI Teammates, an orchestration layer for agents, and the AI platform supporting all Asana AI features, covering model access, retrieval, context, evaluation, and production quality. We are seeking a Senior Staff Software Engineer to lead technical direction across this organization, tackling complex cross-team challenges, making critical architectural decisions, and shaping the future of AI within Asana's products. This role involves influencing strategy across multiple engineering teams located in San Francisco, New York, Vancouver, and Warsaw.

$297k - $350k

Luma is seeking a Research Scientist/Engineer to focus on optimizing the performance of their multimodal models. This role involves profiling and enhancing GPU, CPU, and accelerator code to ensure efficient training and scalable deployment without compromising quality. You will be responsible for writing kernels and operations that maximize hardware utilization and minimize latency, requiring deep expertise in GPU optimization, transformer internals, and low-level programming.

$195k - $395k

Luma is seeking a Research Scientist/Engineer to focus on optimizing the performance of their multimodal models. This role involves profiling and enhancing GPU, CPU, and accelerator code to ensure efficient training and scalable deployment without compromising quality. You will be responsible for writing kernels and operations that maximize hardware utilization and minimize latency, requiring deep expertise in GPU optimization, transformer internals, and low-level programming.

Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.

$195k - $395k

Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

Lambda, The Superintelligence Cloud, is seeking a Senior Systems Engineer to join their Enterprise AI Platforms team. This role focuses on building and scaling the internal systems that power Lambda's business, partnering across departments to implement tools, automate workflows, and ensure data integrity. You will be instrumental in designing, developing, and deploying software and services to enhance the availability, scalability, reliability, and efficiency of Lambda’s internal IT systems and platforms. The position requires a proactive approach to problem-solving, automation, and influencing the creation of new architectures for large-scale distributed systems, with a strong emphasis on AI infrastructure and tooling.

$206k - $275k

Anthropic

Anthropic's Environments organization is responsible for building and maintaining the infrastructure that enhances Claude's capabilities through reinforcement learning. This includes developing frameworks for researchers to build environments and the underlying infrastructure for running them, with a core mission to productionize research. The role involves embedding with research teams to understand their workflows and designing frameworks and APIs that accelerate their progress, ensuring these systems are understandable, ownable, and maintainable. A significant part of the role also includes ensuring the health, maintainability, monitoring, and ease of triage for production RL runs. The ideal candidate will possess deep Python expertise, a strong sense of API and framework design, and an intuitive understanding of complex system failures, particularly silent ones. Experience with stateful distributed systems like workflow engines or actor frameworks is a plus. The role requires comfort in navigating and abstracting complex research codebases, incrementally improving them while research continues, and leveraging AI tools for development with a focus on verification.

$405k - $605k

CHAOS Industries is seeking a highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and deploy AI/ML-powered capabilities across its product lines. This role involves working closely with data scientists, software engineers, product teams, and mission stakeholders to conduct advanced AI research and translate it into reliable, real-world software, with a particular focus on defense applications requiring extreme accuracy under constrained, adversarial, and complex operational conditions. The ideal candidate possesses strong data science and software engineering fundamentals, a track record of technical excellence, and demonstrated experience applying AI/ML techniques to real products, with a strong plus for experience in aerospace, defense, critical infrastructure, robotics, RF systems, or other highly regulated or mission-driven environments. Comfort with operating independently, quickly learning new technical domains, collaborating across teams, and moving prototypes toward production with limited oversight is essential.

$140k - $193k

Crusoe is building the operating system for AI datacenters, managing one of the world's largest GPU fleets. This role focuses on building a unified platform that senses, reasons about, and acts on the entire fleet, moving beyond traditional operational methods to achieve fleet autonomy. The platform is designed as a product with an API-first approach, offering SDKs, paved paths, and a self-serve portal for internal teams. It comprises agents for telemetry and command execution, a distributed infra graph, a reconciliation core for state management, and domain services for various operational tasks. The goal is to create an autonomous system that continuously improves through a sense-correlate-reason-act-learn loop, reducing manual interventions and enabling other teams to build services and workflows efficiently.

$250k - $300k

NVIDIA is seeking a Senior MLOps Engineering Manager to lead the build, development, and operation of large-scale, end-to-end data and ML pipelines that power the company's autonomous driving products. This role involves leading a highly technical engineering team responsible for building and operating cloud-scale pipelines that ingest, validate, process, and transform multimodal sensor data into high-quality training, evaluation, and validation datasets. These pipelines are foundational to the autonomous vehicle program and directly enable customer-facing autonomy features. The ideal candidate will be a seasoned engineering leader with strong ownership and a passion for customer-focused development, capable of scaling systems and teams in a fast-paced, multi-functional environment.

$272k - $431k