Distributed Systems Jobs

The Agent Capabilities team at Perplexity Computer is at the forefront of agentic AI, bridging frontier AI research with product innovation. This team builds the foundational capabilities that empower users and agents to tackle increasingly complex tasks. They are responsible for translating cutting-edge AI model breakthroughs into reusable product features, evaluating emerging model capabilities, identifying user value, and transforming these into reliable, scalable, high-quality experiences. This role offers broad ownership at the intersection of AI research, agent systems, platform engineering, and product innovation.

$220k - $405k

Anthropic

The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers Claude's ML-based safety systems. This role involves collaborating closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production, owning the research-to-production transfer of new safety technologies critical for every Claude model launch. The team builds for scale, serving thousands of ML classifiers for all requests on the token generation path and for every platform Claude runs on. Engineers will work at the intersection of machine learning, large-scale distributed systems, and AI safety, developing platforms and tools that enable safeguards to operate reliably at scale, with tooling and infrastructure used for every model launch.

$320k - $485k

Anthropic

The Safeguards ML Sampling Path team builds and operates the production services that power Claude's safety systems. These services are critical, sitting on the token generation path across every platform Claude runs on. You will be responsible for keeping p99 latency flat as traffic grows, building for robustness against dependency failures, and safely shipping changes to a system that cannot go down. This role requires a strong foundation in distributed systems and a focus on designing systems for graceful degradation.

$320k - $485k

OpenAI

We are seeking a Software Engineer to develop the research infrastructure and tooling that will enable OpenAI models to design silicon. This role involves transforming chip-design workflows into robust environments for reinforcement learning and evaluation, and simplifying the process for researchers to conduct experiments and iterate on new ideas. You will bridge software engineering, tool integration, and open research challenges, leveraging strong coding fundamentals, clear technical judgment, and independent execution. While prior chip-design experience is beneficial, domain knowledge can be acquired alongside our hardware specialists.

$266k - $468k

Fireworks is seeking PhD graduates in Computer Science, Computer Engineering, or Electrical Engineering to join their Systems Infrastructure team. This role is for individuals who want to apply their research ideas to real-world, large-scale AI infrastructure. You will be responsible for designing and building the core systems that power Fireworks' AI platform, including schedulers, storage systems, and networks, ensuring efficient utilization of hardware and low inference latency. You will work on challenging problems related to compute placement, efficient data movement, and high-performance networking for AI workloads, with the opportunity to see your work ship in a production environment.

$200k - $230k

Mercor is a leading AI data company that organizes human intelligence to power the AI economy. We are building the layer between human expertise and frontier models, enabling millions of domain experts to train AI models. Our mission involves creating a new category of work where expertise drives AI advancement, requiring an ambitious and committed team working at the forefront of AI systems. The Frontier Data Products team is responsible for transforming complex multimodal inputs (images, video, audio, documents) into reliable, customer-ready data products at scale. This role is a player-coach position, balancing technical contributions with people leadership, including writing production code, owning architectural decisions, and resolving complex production issues. It also involves hiring, coaching, and organizing a team to operate with clear ownership and independent judgment, focusing on product quality, reliability, and usefulness.

$300k - $420k

Blee is an AI-first marketing content compliance platform trusted by major companies like PayPal, NerdWallet, and Brex. We are a YC-backed startup defining a new category in compliance across various industries. We value in-person collaboration but offer remote opportunities for exceptional candidates, with regular off-sites and opportunities to connect across offices. You will join a team focused on clarity, ownership, and building impactful solutions.

$150k - $275k

NVIDIA's Site Reliability Engineering (SRE) team is seeking a Principal SRE to shape the technical direction of the company's AI Platform Runtime. This role involves leading reliability engineering initiatives across multiple organizations, solving complex enterprise-scale problems, and establishing architectural standards for critical AI-powered services. The Principal SRE will also drive the adoption of AI agents and skills to enhance platform operations and developer productivity. The team values intellectual curiosity, diversity, collaboration, and continuous learning through blameless analysis, encouraging bold thinking and impactful improvements.

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team operates with intensity, ownership, and a commitment to excellence, valuing decisiveness, simplicity, and continuous improvement. If you are driven to do your best work alongside like-minded individuals, Harvey is the place to be.

$231k - $340k

Moveworks is building the runtime infrastructure that powers its AI agents, which deliver real-time responses to millions of enterprise users. This role focuses on distributed systems engineering at the core of agentic AI. The AI agents can plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.

Moveworks is building the runtime infrastructure that powers its AI agents, enabling them to orchestrate, execute, and deliver responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan, execute multi-step workflows, call tools, and interact with users, all while ensuring correctness, observability, and low latency. The successful candidate will build and own the systems that make these advanced agent capabilities possible.

Moveworks is building the runtime infrastructure that powers its AI agents, which are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI. The AI agents are designed to plan and execute multi-step workflows, interact with tools, and manage human input, all while ensuring correctness, observability, and low latency. The systems responsible for these capabilities are what you will build and own.

We are seeking a Senior Software Engineer to join our team and build the runtime infrastructure that powers Moveworks' AI agents. These agents are responsible for orchestrating, executing, and delivering responses to millions of enterprise users in real time. This role focuses on distributed systems engineering at the forefront of agentic AI, enabling our AI agents to plan, execute multi-step workflows, call tools, and interact with users while maintaining correctness, observability, and low latency. You will build and own the core systems that make these advanced agent capabilities possible.

Cerebras Systems is seeking a hands-on SDET Technical Lead to establish and lead Release Integration Testing for AI Inference Core. This role is crucial for transforming integrated features into reliable production releases by defining the quality strategy across the entire release cycle, from feature integration to post-release learning. You will work across AI frameworks, runtime, compiler, kernels, distributed systems, infrastructure, and hardware to identify and address release risks. This is a technical leadership position where you will design test architecture, lead debugging and release decisions, mentor engineers, and contribute to software and automation development.

Lightning AI is seeking a Senior Application Security Engineer to safeguard their AI, machine learning, and inference platforms. This is a hands-on technical role focused on integrating security into modern AI infrastructure, inference systems, and developer platforms. You will collaborate with platform engineers, ML engineers, and infrastructure teams to identify risks, design secure architectures, and develop security tooling that empowers engineers to operate efficiently and securely. The role is execution-driven, involving technical implementation, in-depth security reviews, and contributing to the growth of application security capabilities.

$180k - $220k

Anthropic

Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms.

$320k - $485k

NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. You will deliver hands-on technical assistance for advanced AI deployments, intricate distributed systems, and ensure customers realize efficient performance from NVIDIA's AI platform across varied environments. We partner with the world's most innovative AI companies to address their most challenging technical problems. In this role, you will develop innovative solutions that advance AI infrastructure capabilities and directly influence customer success with breakthrough AI initiatives.

$184k - $357k

Perplexity is seeking a Technical Program Manager to act as the central point of contact between our model providers, engineering, and product teams, driving the advancement of our core inference platform. This role is crucial for managing one of the industry's highest-throughput inference stacks, serving diverse traffic across a dynamic portfolio of models. You will operate at the nexus of product, engineering, and finance, coordinating the smooth integration of new models and capacity while executing the roadmap for the inference platform itself. The ideal candidate possesses strong technical acumen, excels at coordinating diverse teams and external partners with competing deadlines, and is motivated by establishing operating models for functions with limited precedent.

$170k - $265k

Anthropic

Anthropic is building reliable, interpretable, and steerable AI systems to be safe and beneficial for users and society. This role leads a team of engineers focused on the critical control plane for Anthropic's inference fleet. This involves making key decisions about request routing and capacity allocation to meet throughput, reliability, and latency goals. The team designs placement and load-balancing algorithms, builds quantitative models for demand and performance, and optimizes latency across various system boundaries. The Engineering Manager will guide a team of ML platform, infrastructure, and distributed systems engineers, ensuring the efficiency, reliability, and evolution of the entire request-to-model path.

$405k - $625k

Physical Intelligence is building general-purpose AI for the physical world, developing foundation models and learning algorithms for robots and future devices. As an ML Infra Engineer focused on Data Systems, you will construct and manage the data infrastructure essential for large-scale robot learning. Your work will bridge raw data sources and the training/evaluation phases, ensuring speed, accuracy, and reliability as systems scale. This role is a systems-focused position at the intersection of distributed systems, storage, and machine learning infrastructure.