Distributed Systems Jobs

205 open roles mentioning Distributed Systems

Software Engineering MTS

8d ago
S

Salesforce

Salesforce is seeking a Software Engineering MTS to join a new internal cloud platform team focused on network security controls and management. The mission is to develop highly-available, performant distributed systems that provide security at the network level across Salesforce's public cloud, encompassing microsegmentation, network policy distribution, access control, distributed firewalls, and DDoS prevention. This role involves designing and operating platforms that enforce security policy across a multi-cloud, multi-substrate environment, with a strong emphasis on distributed systems, networking, and building security infrastructure at scale. The role also emphasizes integrating AI agents into human workflows to drive efficiency and innovation, and contributing to the shared system context that enables AI to operate reliably.

$117k - $177k

California - San Francisco remote
AnthropicAWSAzure +11 more

Senior/Lead Engineer, Performance Engineering

8d ago
S

Salesforce

Salesforce is seeking a Senior/Lead Performance Engineer to join the SalesforceDB team, which manages the transactional database powering the Salesforce Platform. This role involves driving the design, scalability, and performance of our distributed database technology. You will identify and resolve performance bottlenecks, lead benchmarking efforts, and build telemetry to monitor production fleet performance. This is a fast-paced, collaborative environment where your work directly impacts the performance and scalability of a system handling trillions of transactions monthly.

$149k - $260k

California - San Francisco remote
PythonJavaAI Agents +6 more

Staff Software Engineer, AI Runtime

8d ago
Databricks

Databricks

Databricks is seeking a Staff Software Engineer for its AI Runtime (AIR) team. AIR is a managed platform designed for large-scale GPU training and fine-tuning of state-of-the-art AI models, providing customers with on-demand access to accelerators and a serverless experience. As part of this role, you will be instrumental in building and scaling the systems that ensure fast, reliable, and effortless large-scale training. You will influence the architecture and development of the managed GPU training stack, focusing on areas like scheduling, distributed training performance, fault tolerance, and the overall developer experience for operating jobs at scale. This position also involves defining the long-term technical vision for AIR, mentoring senior engineers, and collaborating with product, research, and platform teams to expand the impact of custom training at Databricks.

$190k - $265k

Mountain View, California; San Francisco, California remote
Fine-TuningPyTorchDistributed Training +9 more

Technical Curriculum Developer, Platform - EMEA

8d ago
C

ClickHouse

The Learning Team at ClickHouse is expanding rapidly, and we're seeking a Technical Curriculum Developer to enhance our hands-on training experience. This role involves accelerating technical content creation by integrating AI-powered tools and agents directly into the learning process. You will be responsible for the infrastructure that supports content releases, certification exams, courses, and learning environments. Additionally, you will spearhead GenAI initiatives to improve content development efficiency and build an AI-powered user experience for our students.

Europe remote FullTime
AWSAzureGoogle Cloud +11 more

Inference Systems Performance Architect

8d ago
S

SambaNova

SambaNova is seeking an Inference Systems Performance Architect to lead the end-to-end performance strategy for their AI inference platform. This role involves defining and driving technical direction in workload capture, benchmarking, modeling, and simulation. You will be instrumental in understanding how requests move through the system, from tokenization to fabric communication, and how deployments meet customer service level objectives. The work focuses on creating reproducible representations of real and agentic traffic, developing what-if capabilities for future configurations, and tackling complex challenges in heterogeneous inference environments.

$245k - $325k

San Jose, California, United States remote
LLMAI AgentsInference +7 more

Senior ML Infrastructure Engineer

8d ago
S

SambaNova

SambaNova is seeking a Senior Software Engineer to join the ML Infrastructure team. This role is central to our mission as an inference-first company, focusing on designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. You will transform state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud. This position involves end-to-end ownership of systems including request scheduling, advanced decoding algorithms, caching layers, API surfaces, and accuracy infrastructure, and requires close collaboration with ML, compiler, runtime, and product teams.

$200k - $275k

Austin, Texas, United States; San Jose, California, United States remote
PythonLLMAPIs +7 more

Software Engineer, AI Agents

8d ago
C

Cloudflare

At Cloudflare, we are building industrial-scale AI agents to directly support customers, moving beyond research to deliver real-world impact from day one. This role involves assembling existing Cloudflare technologies like Workers, Durable Objects, KV, R2, D1, Vectorize, Workers AI, AI Gateway, and the Agent SDK into functional agents that customers will use daily. The primary goal is to ship production agents on the Cloudflare stack, iterating rapidly through building, deploying, and learning. Your code will serve as the primary interface for Cloudflare customers interacting with these AI capabilities.

In-Office onsite
TypeScriptRustMCP +14 more

Senior Machine Learning Engineer

8d ago
C

Cloudflare

We are seeking a visionary and hands-on Lead Machine Learning Engineer to join our Austin team. In this role, you will be the principal architect behind the next generation of our unified AI/ML platform, designing and building the infrastructure that powers everything from traditional predictive models to generative AI, large language models (LLMs), and autonomous agent frameworks. You will own the end-to-end technical strategy, blueprint, and execution of scalable backend services and data pipelines that support AI-driven applications across go-to-market, engineering, and product teams. Because our products are initiated and owned entirely within the team, you will drive the vision from initial requirements and system design to global deployment, optimization, and long-term evolutionary ownership.

Hybrid hybrid
LangGraphLangChainPython +11 more

Software Engineer, AI Agents

8d ago
C

Cloudflare

At Cloudflare, we are building industrial-scale AI agents to directly support customers, moving beyond research to deliver real-world impact from day one. This role involves assembling existing Cloudflare technologies like Workers, Durable Objects, KV, R2, D1, Vectorize, Workers AI, AI Gateway, and the Agent SDK into functional agents that customers will use daily. The primary goal is to ship production agents on the Cloudflare stack, iterating rapidly through building, deploying, and learning. Your code will serve as the primary interface for Cloudflare customers interacting with these AI capabilities.

In-Office onsite
TypeScriptRustMCP +14 more

Engineering Manager, Agentic Internet & Data Insights

8d ago
C

Cloudflare

Cloudflare is seeking an Engineering Manager to lead a team focused on AI and Internet Data Insights. This role is within the Emerging Technologies & Incubation (ETI) department, responsible for building and launching new products. The team operates at the intersection of AI, search, retrieval, data insights, and product engineering, addressing emerging challenges in how AI agents discover and interact with the internet. Cloudflare's unique network position allows for solving problems at massive scale, improving content discoverability, and transforming internet signals into valuable customer experiences. The ideal candidate will be deeply technically credible, capable of understanding complex systems, challenging architectural decisions, and stepping in to solve technical problems when necessary. Success will be measured by the team's output, engineer development, and the quality of delivered systems and products.

Hybrid onsite
RAGAI AgentsAPIs +4 more

Staff Forward Deployed Engineer

8d ago
L

Lovable

We are seeking an experienced Staff Forward Deployed Engineer to join our team and help build the future of AI-powered software creation. This is a hands-on software engineering role where you will design, write, and ship production code, working directly with customers to translate ambitious ideas into real products. You will be a founding member of our Forward Deployed Engineering (FDE) function, helping to define its engineering standards, ways of working, and collaboration with product teams. This is a unique opportunity to scale a new discipline from scratch, solve novel AI problems, and shape a product and team while remaining deeply hands-on.

$199k - $325k

New York City remote FullTime
AWSGoogle CloudCloudflare +8 more

Engineering Manager, AI Platform

9d ago
H

Harvey.ai

Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform. As we scale rapidly and take on increasingly complex use cases, we are expanding our engineering team to accelerate our ability to ship fast, delight users, and build infrastructure that scales with us. As an Engineering Manager for AI Platform, you will lead and scale a team of engineers building the foundational systems that power AI across Harvey. This includes model access and routing, agent and workflow orchestration, evaluation frameworks, tool and context infrastructure, and the observability needed to run LLM-powered products reliably at scale. You will partner with Product, Research, and product engineering teams to turn fast-moving advances in applied AI into durable, reusable platform capabilities and set the technical direction for how teams across Harvey build, test, and ship AI features. This role requires both technical depth and product intuition, with a focus on making fast, high-quality decisions, working at the cutting edge of applied AI, and growing a team that embodies engineering excellence.

$272k - $355k

San Francisco remote FullTime
PythonGoLLM +7 more

Senior+ Full-Stack Engineer

9d ago
N

Nango

Nango is a developer infrastructure company providing API access for agents and apps, enabling AI applications to connect to the real world. We are a YC-backed company with multi-million ARR and a growing team. We are seeking Senior+ Full-Stack Engineers to join our core engineering team. This product engineering role involves taking features from customer conversations to shipped products, encompassing the API, runtime, and dashboard. As we sell to developers, our engineers play a direct role in shaping the product roadmap, specifications, and execution, owning product surfaces end-to-end and influencing Nango's evolution as more customers build agents.

$140k - $220k

USA remote FullTime
AWSTypeScriptMCP +8 more

Security Engineer / Research Engineer, RL Security

9d ago
Anthropic

Anthropic

Reinforcement learning is crucial for training AI models like Claude to reason, write code, and act autonomously. At scale, RL training involves complex distributed systems running across numerous accelerators and hosts. As an engineer in RL Engineering, you will be responsible for securing this expanding system. This is a hands-on role where you will work directly within the RL codebase and its underlying infrastructure, collaborating with the engineers and researchers who develop and utilize it. The system's rapid evolution, driven by research advancements, requires security solutions that maintain pace without compromising performance or development velocity. We are seeking candidates with expertise in either security engineering for large-scale ML systems or ML systems/research engineering with a strong interest in security.

$320k - $405k

San Francisco, CA | New York City, NY | Seattle, WA hybrid
AnthropicKubernetesPython +8 more

Research Engineer, Interpretability

9d ago
Anthropic

Anthropic

The Interpretability team at Anthropic is dedicated to understanding how modern language models work, believing that a deep, mechanistic understanding is crucial for making advanced AI systems safe and steerable. This role involves building and maintaining the specialized infrastructure that powers interpretability research, akin to performing 'neuroscience' on neural networks. The work spans the entire lifecycle of a production language model, from pretraining and inference to performance optimization, and directly contributes to safety audits on frontier models.

$315k - $560k

San Francisco, CA remote
AnthropicPythonGo +8 more

Software Engineer, AI Gateway

9d ago
V

Vercel

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

$196k - $294k

Hybrid - San Francisco remote
OpenAIAnthropicTypeScript +9 more

Software Engineer, Storage

9d ago
G

Glean

Glean is seeking a Backend/Infrastructure Engineer to build and evolve the Storage layer that powers a highly available, performant, secure, and cost-effective suite of storage options for all data at Glean. You will own the storage systems that handle Glean’s most sensitive data, from enterprise documents and permission hierarchies to user behavioral signals and real-time query path data. Your work will directly enable organizations at scale to discover and act on their critical knowledge, supporting millions of searches, chat interactions, and agent workflows. You’ll deliver robust uptime guarantees, autoscaling, and reliable alerting/monitoring for a key component that runs across multiple cloud providers. As part of the Storage team, you’ll be responsible for a critical piece of Glean’s infrastructure, working closely with several other teams to support their workloads. You’ll also work across the stack to abstract cloud differences, reduce human intervention through self-healing systems, and drive real business impact by enabling Glean’s ever-growing scale.

$200k - $300k

Mountain View, CA remote
AWSAzureGoogle Cloud +8 more

Software Engineer, Agentic Runtime

9d ago
G

Glean

The Agentic Runtime team builds the low-latency, reliable, and secure foundation that powers Glean’s AI agents and assistant experiences at scale. You’ll design and operate core runtime services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety. You’ll work across distributed systems, production observability, and ML infra integrations to deliver an experience that feels instant, accurate, and trustworthy — while optimizing cost and reliability.

$180k - $210k

Mountain View, CA remote
OpenAIAnthropicGoogle Gemini +11 more

Staff+ Software Engineer, VectorDB

9d ago
Anthropic

Anthropic

Anthropic is seeking a Staff+ Software Engineer to enhance the vector search infrastructure powering Claude. This role is crucial for Claude's ability to access information, impacting web search, conversation memory, and model training. You will join a small, foundational team responsible for the architecture, performance, scalability, and cost of the vector database layer. As a hands-on engineer, you will contribute to coding and make key architectural decisions, shaping the future evolution of this critical system within the Databases organization.

$320k - $485k

New York City, NY | Seattle, WA; San Francisco, CA | New York City, NY | Seattle, WA hybrid
AnthropicGoRust +10 more

Software Engineering, AI Systems (SMTS)

10d ago
S

Salesforce

Salesforce is seeking a Software Engineering, AI Systems professional to join Salesforce AI Labs. This role involves building a product that learns from human demonstrations to automate complex workflows across enterprise applications. You will tackle challenging engineering problems related to agent dependability, reasoning, and error recovery. The position offers the opportunity to work directly with customers, own substantial systems from design to deployment, and contribute to taking a new offering from early adoption to general availability, supported by Salesforce's scale.

$149k - $224k

California - San Francisco remote
PythonTypeScriptJavaScript +8 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.