Distributed Systems Jobs

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

Figma's AI Tools team is building AI-powered workflows, platforms, and tooling to enhance engineer productivity. This team owns systems that transform software development, including agentic CI auto-fixing, AI-assisted code review, and cloud agents that automate tasks like turning Slack messages into pull requests. The team operates across a three-layer platform stack: sandbox runtime, cloud agents, and workflow orchestration, while maintaining a growing portfolio of org-wide developer workflows.

$258k - $376k

Figma is seeking a Data Platform Engineer to join their Data Engineering team. This role will focus on building the foundational systems that power Figma’s next generation of AI-driven products and data experiences. You will be an early engineer shaping the company's ML and data platform, enabling self-serve analytics and production-grade AI systems. The position involves working at the intersection of data, infrastructure, and machine learning to build scalable systems that empower Data Science, unlock AI capabilities, and bring data and models closer to the product experience.

$153k - $376k

Baseten is seeking a Software Engineer to join the Agent Infra team, focusing on building and enhancing Agent Drive, a distributed filesystem critical for agent sandboxes. This role involves developing a storage solution that supports thousands of concurrent sandbox mounts with strict data isolation and consistency. The work leverages advanced storage techniques like tiered caching, replication, and content-addressed data, with a focus on Linux filesystem internals. The team operates with a high degree of ownership, shipping features rapidly and contributing to the core infrastructure that powers leading AI companies.

$160k - $330k

Snorkel AI is seeking Senior and Staff Product Engineers with strong backend experience to help shape and deliver product capabilities that simplify complex workflows for users. This role involves owning backend features from concept to production, collaborating closely with Product, Design, and Engineering teams. You will be instrumental in building and evolving APIs, services, data models, and workflow capabilities that support the product, focusing on areas like data cataloging, agent benchmarking, and workflow automation. The ideal candidate possesses sound technical judgment and a commitment to product quality, usability, and impact.

$208k - $315k

Nebius is a leading cloud infrastructure provider for the global AI economy, building a full-stack AI cloud platform. We are seeking a Senior Customer AI Engineer to join our Token Factory team. This role focuses on helping customers successfully transition their AI workloads from proof-of-concept to production and scale them on Nebius infrastructure. You will operate at the intersection of engineering, delivery, and customer success, ensuring reliable, performant, and cost-efficient deployments. You will collaborate closely with customer engineering teams, Solution Architects, and Product/Infrastructure teams.

NVIDIA is seeking an engineering lead to architect and scale the data acquisition infrastructure that powers our foundation models. This hands-on technical leadership role spans distributed systems, crawl infrastructure, and third-party data ingestion, focusing on building systems that discover valuable sources, crawl the open web at scale, and deliver reliable, high-quality data to training pipelines. You will own the architecture of a unified platform covering source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion, with the goal of bringing existing infrastructure to pretraining scale and extending it to additional model families, modalities, and acquisition workflows. You will also lead architecture reviews, critical implementation work, mentor engineers, and help build the team.

$272k - $431k

Turing's Enterprise AI unit is seeking a Forward-Deployed AI Engineer to join its initial team. This role operates with the speed and focus of a startup, defining the frontier of applied AI in the workplace. You will own outcomes end-to-end, from identifying high-value customer problems and shaping architecture to building production systems and collaborating directly with senior client leaders. This is an intellectually challenging role focused on developing generative AI solutions that drive measurable impact and ROI within large institutions.

$200k - $250k

Perplexity is seeking software engineers to join our Training Infrastructure team. This team is responsible for large-scale RL and agent evaluation platforms that enable the company to train state-of-the-art models and optimize agent harnesses. As a full-stack engineer on this team, you will build distributed systems that orchestrate AI workloads across global-scale compute infrastructure, define novel user and agent interfaces for designing, managing, and launching experiments, and create tools that make experiment results legible to humans and agents alike. A strong candidate will possess both experience and passion for solving difficult problems at the intersection of AI, distributed systems, and research acceleration.

$220k - $405k

You will design and build the core infrastructure that powers AI inference across Cloudflare's global network. This includes real-time voice, frontier open LLMs, and customer-deployed models running on a heterogeneous fleet of GPUs and next-generation accelerators. You will work alongside AI/ML engineers, hardware partners, and Cloudflare product teams to solve complex problems in distributed systems and high-performance computing. The role involves addressing challenges such as sub-second model cold starts, multi-accelerator workload scheduling, efficient KV cache management, and developing a model deployment platform for both internal use and customer models. This is an opportunity to be at the center of building a novel AI inference platform embedded in the fabric of the internet, defining how AI runs at the edge of the network.

$194k - $266k

AI inference is becoming core infrastructure, and AI Gateway is Cloudflare's solution to provide developers with reliable, observable, secure, and cost-controlled access to multiple AI models across various providers, all at the network edge. This is a hands-on individual contributor role focused on building this critical layer. You will work across the entire stack, from distributed systems and high-throughput APIs to developer-facing tools like SDKs and dashboards, shaping how developers build and operate AI applications on Cloudflare. The ideal candidate thrives in the fast-paced AI ecosystem, building durable infrastructure amidst rapidly changing APIs and models, and is excited about using AI to improve the software development process itself.

$194k - $266k

Cloudflare's Emerging Technologies & Incubation team builds and launches bold new products on Cloudflare’s edge network. This role is on the Durable Objects team, which powers stateful serverless applications for Cloudflare customers. You’ll help evolve the runtime and the low-level routing and storage systems that support real-time chat, multiplayer games, AI agents, and other stateful workloads at scale. We are looking for builders who see the cracks in the Internet and have the curiosity to create solutions using the latest tools, leveraging AI to ship faster and make things better.

$194k - $266k

HUD is building reliable, fair, and open infrastructure for AI data, aiming to make data valuable for creators and trustworthy for AI training labs. As a Senior Research Infrastructure Engineer, you will accelerate research on training and evaluating frontier AI agents by building the software and infrastructure that enables researchers to iterate on environments, collect trajectories, and evaluate model behavior. You will collaborate closely with research engineers to understand their needs, identify bottlenecks, and transform research code into robust, reusable systems, owning the tools, pipelines, and execution infrastructure that support their exploration and scaling of promising approaches.

$175k - $260k

Glean is seeking a Senior Site Reliability Engineer to enhance the reliability, scalability, and operational excellence of its production services. This role involves designing, building, and operating resilient cloud infrastructure, improving service reliability against defined SLOs, and assisting teams in responding to production issues through effective observability and incident management practices. You will provide technical expertise for system and architectural decisions and collaborate with engineers across the organization to deliver dependable systems. Glean operates in a hybrid cloud environment and faces complex distributed-systems challenges due to its rapid growth. Your work will involve using software engineering and SRE skills to automate tasks, build tools, and improve deployment, monitoring, and on-call workflows, ultimately helping Glean scale and provide a reliable customer experience.

$200k - $260k

Asana is seeking a Senior Software Engineer to join its AI organization in Vancouver, focusing on pioneering a new category of technology as a human-agent operating system. This role involves doubling down on Asana's AI Suite to provide customers with end-to-end intelligent orchestration. Depending on team placement, you might lead architecture for the core agentic runtime, develop high-throughput evaluation and safety infrastructure, or build sophisticated customer-facing tools for coordinating humans and AI agents. The position offers a streamlined technical interview process with a focus on matching candidates to the ideal team.

$176k - $200k

Asana is seeking a Software Engineer to join its AI organization in Vancouver, focusing on building the human-agent operating system. This role involves contributing to core AI teams, from platform infrastructure for autonomous agents to trust and evaluation systems, and product surfaces for AI-orchestrated workflows. The position offers a hybrid work arrangement based in the Vancouver office, with specific in-office days and potential for remote work on other days, depending on the role's needs.

$146k - $162k

Lovable is seeking an exceptional Forward Deployed Engineering Lead to help build the future of AI-powered software creation. This role involves building and leading an outstanding Forward Deployed Engineering (FDE) team, while collaborating with other FDE leaders to define the function's global operations. You will remain deeply hands-on, working directly with ambitious customers, writing production code, and contributing to projects alongside your team. Lovable is a software creation platform empowering individuals and businesses to bring ideas to life, having facilitated over 60 million projects since its launch. The company is a fast-growing, generational AI company with a culture of extreme ownership, high velocity, and low-ego collaboration.

$241k - $391k

Glean is seeking a Software Engineer to help build a scalable software platform, including enterprise search solutions. This role involves working across distributed systems, data pipelines, APIs, and user interfaces to deliver secure, high-quality products. You will contribute to a platform that powers intelligent search, an AI assistant, and AI agents, with a focus on enterprise-grade AI solutions. The work is deeply embedded in how people get things done, shipping agentic capabilities on an open, extensible stack.

$187k - $234k

Glean is seeking a Software Engineer to help build a scalable software-based platform, including enterprise search solutions. You will work across distributed systems, data pipelines, APIs, and user interfaces to deliver secure, high-quality products that meet customer needs. This role involves building large-scale, fault-tolerant distributed systems and implementing data ingestion pipelines to create secure search indexes. You will also design and implement user interfaces for enterprise content search and APIs for related applications.

$187k - $234k