Distributed Systems Jobs

NVIDIA is seeking a Senior Software Engineer to join the NeMo Helix Core team, responsible for building and shipping an open-source, plugin-based AI platform. This platform is designed for developing, evaluating, deploying, and operating AI systems at scale, with a particular focus on optimizing and orchestrating AI Agents across various compute backends. The role involves contributing to a sophisticated agent execution framework that enables parallel experimentation to find efficient agent architectures, making AI systems more sustainable and cost-effective by reducing token usage and improving throughput.

$184k - $357k

Salesforce is seeking a Lead Software Engineer to join the Platform Services team within the Digital Marketing Technology organization. This role offers hands-on technical leadership in architecture, platform innovation, and large-scale distributed systems. You will collaborate with engineering, product, and architecture teams to design and build scalable cloud-native services that power Salesforce's global digital ecosystem. This is an individual contributor role focused on solving complex technical challenges, mentoring engineers, and improving engineering standards across teams.

$173k - $260k

The Developer Experience team at Moveworks builds platforms that empower developers working on the Moveworks Agentic AI platform. This role is central to owning the technical foundation for the team's output, focusing on designing and building complex platform challenges related to generality, scalability, and extensibility, all while prioritizing the developer experience. The ideal candidate thinks in systems, ships impactful solutions, and effectively collaborates with and influences others.

$191k - $334k

Reducto is seeking a Software Engineer for its Platform team to own the infrastructure behind the company's core API. This role involves ensuring document understanding systems are fast, reliable, and cost-efficient at scale. You will work across Python services, queues, model-serving, Kubernetes, observability, and developer tooling to enhance the platform's robustness. This is a high-leverage infrastructure position for someone who has built and operated production systems, prioritizes latency, reliability, and cost, and is adept at using modern LLM coding tools.

$200k - $325k

Databricks

Databricks is seeking a dedicated Senior Engineering Manager to help grow the AI/BI Dashboard product and service platform. This role involves tackling challenging full-stack and backend problems, focusing on making agentic dashboard authoring and AI insights fast and performant while maintaining high quality. The manager will enable the creation and consumption of Dashboards and BI features across the entire Databricks platform and scale the service to a significantly larger user base. A key aspect of this role is applying AI and LLM technology directly into the product surface and guiding the team to balance quality with performance and cost.

$229k - $314k

Commure is building the AI Operating System for healthcare, transforming how care is delivered, documented, and financed. Our platform encompasses Ambient AI for documentation, intelligent Agents for workflows, and autonomous RCM, all integrated with numerous EHRs. We are seeking a Staff Backend Engineer to help build and operate the foundation for our next-generation ambient AI product suite. This role involves working across audio ingestion, media processing, inference orchestration, distributed workflows, storage, observability, and cloud infrastructure, focusing on making complex systems dependable and ensuring they create a fast, reliable, and trustworthy experience for clinicians.

$210k - $275k

AgentMail is building the communication infrastructure for AI agents, enabling them to communicate and operate independently across various services. We've processed hundreds of millions of emails and serve developers building ambitious agentic products. We are seeking a Founding Product Engineer to define the customer experience of AgentMail. This role involves owning products from initial customer problems to daily developer use, encompassing end-to-end development across frontend, APIs, backend services, data models, and infrastructure. You will engage directly with customers, translate their challenges into product solutions, and shape the developer experience. The role requires rapid prototyping, meticulous attention to detail in product design and interaction, and contributing to the product engineering culture.

$175k - $250k

Sierra is seeking a Software Engineer for its Inference team to build the systems that power their AI agents. This role focuses on making foundation models fast, reliable, and efficient at scale. You will define the inference architecture, working on systems for serving, routing, capacity management, and optimization for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI, requiring strong distributed systems fundamentals and experience with complex systems problems.

$230k - $390k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

The Analytics Compute Platform team at Amplitude owns the critical compute layer that powers every chart, insight, and experiment result seen by customers. This team sits between Amplitude's front-end analytics products and its proprietary analytics database, Nova, and is responsible for the compute API that translates user queries into fast, accurate answers. The core mandate is to enable a highly performant, reliable, and flexible system for computing insights, navigating the inherent tradeoffs between these goals. Day-to-day, you will collaborate closely with engineers across various product teams, including data management, marketing analytics, Session Replay, Experiment, CDP, and Query, as they are all consumers of the team's work.

$167k - $230k

Anthropic

Our team studies how large teams of agents scale to solve complex problems that a single agent cannot, such as rewriting major codebases or formalizing mathematics. We investigate the impact of increasing agent numbers, compute budget, and task length on performance, cost, and coordination. This role bridges research and engineering, involving designing and running large experiments, building the necessary systems, and analyzing surprising results. We aim to move quickly from vague questions to running experiments, developing the platform and evaluations Anthropic uses to measure and manage large agent teams.

$500k - $850k

ClickHouse Labs is an applied research group focused on identifying and solving challenging problems in database systems, with a goal of advancing the state of the art and translating research into real-world system improvements. As a Research Scientist, you will tackle high-impact problems at the intersection of database systems, distributed systems, AI, and systems software engineering. You will collaborate with experienced researchers and engineers on a broad range of topics, including query optimization, execution engines, distributed systems, and emerging agentic workloads, working with leading open-source systems like ClickHouse and PostgreSQL. Your work will involve investigating performance bottlenecks, developing new algorithms and system designs, and evaluating them under realistic conditions, with opportunities to publish your work and contribute to open-source projects.

$175k - $235k

Percepta is transforming critical institutions with applied AI, embedding with industry-leading customers to drive AI transformation. We bring together forward-deployed expertise in engineering, product, and research, along with our in-house toolkit for rapidly deploying agentic workflows and strategic partnerships. As a Research Scientist - Reinforcement Learning, you will work at the intersection of RL research and real-world deployment, advancing decision-making capabilities for critical industries. You will collaborate closely with Embedded Product Managers and engineers to ensure our solutions transform how companies operate.

$200k - $400k

NVIDIA DGX Cloud provides AI services and endpoints for research and production workloads. We are seeking a Senior Production Engineer to develop software and automation that ensures these services are reliable, scalable, and safe to operate. The Production Engineering team focuses on large-scale distributed systems, including internal and external model endpoints, regional control plane services for workload orchestration and request routing, and the GPU/CPU compute infrastructure for inference and agentic workloads. Our work encompasses Kubernetes clusters across various cloud environments (AWS, Azure, Google Cloud, partner clouds) and on-premises deployments.

$184k - $357k

Runpod is seeking a Senior ML Systems Engineer focused on Inference to lead efforts in making LLM inference the fastest and most cost-efficient on their platform. This role involves owning LLM serving performance end-to-end, measuring, understanding, and improving it across various models, hardware, and workloads. The work directly impacts customer latency and cost, requiring a hands-on approach to identify and fix bottlenecks, and ensure reliable production deployment. The ideal candidate will be passionate about AI infrastructure and contribute to building the platform for the next generation of AI developers.

$150k - $220k

Join us as we build the next generation of enterprise search infrastructure powering AI agents. Our mission is to evolve from traditional product-specific search systems into a composable, agent-native platform that enables agents and applications to discover, retrieve, reason over, and recommend information across heterogeneous enterprise data sources. As a Senior Staff Engineer, you will be the technical owner for foundational search infrastructure that serves as the backbone of our agentic platform. You will drive the architecture, scalability, and evolution of core indexing and retrieval systems while partnering closely with Search Ranking, ML, Platform, and AI teams to deliver production-grade search capabilities that power agent experiences across the company.

$191k - $334k

Moveworks is seeking an Agentic AI Harness Architect to define the technical vision for our agentic AI harness. This role involves planning, selecting tools, managing context, and implementing memory, critique, reflection, adaptation, and recovery mechanisms for AI agents. You will invent and prototype algorithms to enable agents to complete complex tasks with minimal supervision and high reliability. The position requires designing model-agnostic abstractions to integrate foundation models, specialized agents, enterprise tools, and workflows, while developing approaches for agent memory and learning that prioritize enterprise security and privacy. You will also create rigorous benchmarks and evaluation methods for agent performance and explore advanced methods like iterative planning, self-critique, and multi-agent coordination. The role includes building prototypes, identifying promising ideas, and collaborating with platform and product teams to bring them to production, while remaining hands-on with code and experiments.

$201k - $352k

SambaNova is seeking a Software Architect to join the SambaStack platform team. This role involves defining the technical direction and architectural strategy for an AI inference platform that serves enterprise AI workloads on SambaNova's RDU hardware. You will own cross-cutting architectural decisions, ensuring the platform meets enterprise-grade standards for scalability, reliability, and performance. This is a high-impact position at the intersection of AI infrastructure, enterprise software, systems architecture, and developer experience.

$245k - $325k

Harvey is transforming legal and professional services by integrating advanced agentic AI with an enterprise-grade platform. This role is a founding position on the Security Engineering team, focused on building the foundational security for AI agents. You will lead the development of a platform that enables agents to perform security work, including vulnerability discovery and validation through authorized penetration testing, while ensuring data and system protection. The work involves shaping how agents are sandboxed across product and internal platforms, building execution environments, orchestration, and controls, and enabling the secure internal use of open-source models.

$231k - $346k

Monte Carlo is seeking a Senior Fullstack Engineer to join their team and build the core of their agent trust platform. This role involves developing backend services, distributed systems, and agentic workflows that enable enterprises to monitor and trust AI in production. You will take ownership of problems from initial concept through prototyping, architecture, development, testing, and deployment, ensuring reliability, observability, and scalability as the platform grows. The position is primarily backend-focused but includes shipping React surfaces when necessary, and involves building and maintaining data pipelines for analytics, ML, and customer-facing features. You will collaborate with product, ML, and infrastructure teams to deliver customer value.

$180k - $230k