Together AI

Together AI

We are seeking a software engineer with a strong focus on reliability to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the API and controllers that enable the inference team to define their needs, such as clusters, model deployments, or capacity changes, and ensures these are reconciled. Your role will be to maintain this functionality in the real world by troubleshooting issues like InfiniBand problems, diagnosing serving faults, and enhancing our automated self-healing systems to permanently resolve recurring failures. The primary goal is to ensure the decoupling remains effective even during disruptions and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing lessons learned from postmortems into system changes. Additionally, you will address the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller-based platforms, and a software engineering approach to GPU infrastructure.

$250k - $320k

Together AI

We are seeking a reliability-minded software engineer to manage the production operations of our Kubernetes-native control plane, which provisions and runs our GPU inference fleet. This platform team develops the manifest-driven API and controllers that enable the inference team to define their needs, such as cluster configurations, model deployments, and capacity adjustments, and ensures these are reconciled. Your role will be to maintain the reliability of this system in production, addressing issues like InfiniBand problems during node communication, diagnosing faults in hero-model and LoRA serving that generic health checks miss, and enhancing automated self-healing to permanently resolve recurring failure modes. The primary goal is to ensure the decoupling remains effective even during failures and to maintain fleet efficiency without introducing new instabilities. You will be responsible for inference serving SLOs and error budgets, leading incident response, and implementing systemic fixes based on postmortem analyses. Additionally, you will contribute to the reliability aspects of capacity efficiency, recognizing that misconfigured defragmentation or bin-packing can pose production risks. We value candidates with hands-on production reliability experience in large-scale distributed or GPU-serving systems, proficiency in troubleshooting InfiniBand/RDMA and Kubernetes controller/CRD-based platforms, and a software engineering approach to GPU infrastructure and its supporting tools.

$160k - $280k

Together AI

The Developer Experience (DevX) team at Together AI is responsible for how developers learn and build on the platform, managing the documentation site, API reference, quickstarts, and cookbooks. They treat documentation as a product, with content living in Git and publishing through Mintlify, synchronized with the API via CI/CD automation. The team also focuses on making content accessible to AI coding agents, developing a house style guide for AI-assisted authoring and structured content. As a Technical Writer Intern on DevX, you will write, test, and ship documentation used by thousands of developers. You will be paired with a mentor and own significant projects from scoping to launch, with real users and metrics. This is a hands-on, technical role where you will run the code you document, call APIs, and contribute to the documentation repository from your first week. Potential projects include building migration kits, making documentation agent-ready, generating CLI reference from source, and writing evaluation design tutorials.

Together AI

As a Forward Deployed Engineer (FDE) focused on Post-Training, you will be a hands-on technical partner to strategic customers who are using fine-tuning and reinforcement learning to build differentiated models on open-source foundations. You will work alongside Solutions Architects as the deep-domain specialist in post-training, guiding customers through data strategy, algorithm selection, experiment design, and evaluation, and sizing the compute required. Your role is crucial in ensuring the successful delivery of post-training Proofs of Concept (POCs), driving adoption of the fine-tuning and RL platform, and translating customer goals into measurable improvements in model quality. This position directly impacts customer success, company growth, and the enhancement of our core platform.

$270k - $300k

Together AI

In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll manage and scale high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies, and solve complex engineering challenges of operating at extreme throughput, low-latency data paths, and massive cluster-scale storage operations. You will also build Kubernetes-native storage operators and self-service platforms that provide automated provisioning, strict multi-tenancy, performance isolation, and quota enforcement at cluster scale.

$250k - $330k

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and company growth.

$270k - $300k

Together AI

As a Technical Support Engineer at a pioneering AI company, you will be the first line of defense supporting customers building training, fine-tuning, and inference solutions. You will address complex technical challenges, provide effective solutions, and act as a product expert. Collaborating with product and sales teams, you will contribute to the continuous improvement of offerings. This role is for a technically proficient individual passionate about AI and customer success, seeking to make a significant impact in a fast-paced, innovative environment.

$160k - $230k

Together AI

We are seeking a software engineer to develop a Kubernetes-native control plane for provisioning and managing our GPU inference fleet. This role involves designing a manifest-driven API that allows the inference team to declare their needs, such as clusters, model deployments, or capacity adjustments. Our controllers will handle the underlying reconciliation, provider/runtime selection, and lifecycle management, abstracting away the complexities of the serving stack, scheduler, or hardware pool. You will also build systems to ensure fleet efficiency, including defragmentation, rebalancing logic for consolidating workloads, and scheduling/bin-packing improvements to maximize GPU utilization without compromising latency. The core objective is to decouple platform users from operational complexities while optimizing hardware capacity. This includes developing controllers, reconciliation loops, and self-service interfaces (API/CLI) for seamless operation, alongside event-driven systems for health monitoring, remediation, and utilization management, all designed to operate without human intervention. A product-oriented mindset is crucial, with a focus on building internal platforms and APIs that enhance the developer experience for consuming engineering teams. This role operates under a "you build it, you own it" philosophy, encompassing both software delivery and production support.

$160k - $280k

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Their work integrates model training, inference algorithms, and serving systems, optimizing all three for reduced cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your solutions against realistic serving workloads, such as long-context and agentic traffic.

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Our work spans model training, inference algorithms, and serving systems, aiming to reduce generation cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your ideas against realistic serving workloads, such as long-context and agentic traffic. Projects are designed to address key research questions in speculative decoding, leading to faster generation on frontier models, drafters that adapt to changing workloads, and robust evaluation under real traffic.

Together AI

This is a unique sourcing role for individuals with a prior engineering background who want to leverage their technical expertise to identify and attract top engineering talent. You will be responsible for proactive outbound sourcing of the top 1% of technical talent in key hubs, evaluating their work, and engaging them through outreach campaigns. The role requires the ability to assess technical skills by reviewing profiles and conducting in-depth technical first calls. You will report to the hiring manager on a small team and have the opportunity to influence the company's technical sourcing and evaluation strategies.

$125k - $190k

Together AI

Together AI is seeking a Staff Platform Infrastructure Engineer to lead service and platform infrastructure strategy across the engineering organization. This is a hands-on technical leadership role with the opportunity to establish a new team and define the standard for how services are built and operated. You will provide a stable, scalable service infrastructure foundation for mission-critical product and platform teams, focusing on reliability, repeatability, and ease of adoption. You will own and evolve crucial shared infrastructure, roll out new patterns and platform capabilities, and ensure services are built on company-wide foundations.

$240k - $280k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This is an architect-and-build role where you will set the architecture for automated bootstrapping of GPU data centers, high-performance virtualization, and fault-tolerant decentralized control planes, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer up to the global management plane that schedules capacity across all data centers. At this level, the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships.

$260k - $300k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining a fast LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Senior Software Engineer focusing on AI Compute, you will build and own major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This virtualized computing platform powers our own SaaS products and serves external cloud customers through self-serve offerings. The hard problems in rapidly scaling heterogeneous GPU fleets are software problems that we solve by building global and in-DC services, Kubernetes operators, and high-performance SDN libraries, forking hypervisors and Linux kernels, and building infra tailored to inference and fine-tuning. You'll own massive greenfield projects across their full lifecycle – scoping the problem, designing the system, and building it through to GA launch.

$220k - $270k

Together AI

Together.ai is seeking a Senior Software Engineer for the Customer Insights team. This team is responsible for the customer-facing visibility layer of Together's Cloud, enabling users to understand, trace, and act on their environment with confidence. You will tackle ambiguous problems, define technical direction, and influence architecture beyond your immediate scope. This role offers significant autonomy, with a collaborative team environment for review and learning.

$180k - $250k

Together AI

The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, advancing open and transparent AI. This role operates at the intersection of model architectures, high-performance systems engineering, and hardware optimization, focusing on co-designing software, algorithms, and models to reduce the cost and latency of AI systems. As a research intern, you will explore distributed inference, compiler-aware optimization, and novel inference-time computation strategies, co-designing and implementing cross-layer optimizations across models, systems, and hardware.

Together AI

The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, advancing open and transparent AI. This role operates at the intersection of model architectures, high-performance systems engineering, and hardware optimization, focusing on co-designing software, algorithms, and models to reduce the cost and latency of AI systems. As a research intern, you will explore distributed inference, compiler-aware optimization, and novel inference-time computation strategies, co-designing and implementing cross-layer optimizations across models, systems, and hardware, with a focus on KV cache design and large-scale serving architectures. Projects aim to unlock unprecedented performance and scale for foundation models, enabling faster serving, larger model deployment, and robust evaluation under realistic serving workloads.

Together AI

At Together AI, you will be responsible for the systems and tooling that enable engineers to ship code quickly and reliably. This includes CI/CD pipelines, release infrastructure, local development environments, and testing systems. This is a build-heavy, high-leverage role where you will drive large projects end-to-end, focusing on building the infrastructure that makes manual effort unnecessary and allows engineers to concentrate on product development.

$180k - $250k

Together AI

Together is seeking a Senior Product Engineer to join their central Product Engineering team, working closely with the Commerce engineering team. You will be responsible for the product UI for Together AI's critical user flows, including enterprise spend controls, governance, usage-based pricing, metering dashboards, payment management, and enterprise contract interfaces. This role requires a hands-on individual who can efficiently break down ambiguous tasks, deliver improvements quickly, and make pragmatic decisions to drive customer and revenue impact. You will collaborate with product, design, and backend engineers, leveraging strong product judgment to make UX decisions within established patterns.

$160k - $230k

Together AI

Together AI is seeking a full-stack engineer to join their Product Engineering team. This role focuses on enhancing the developer experience across their AI platform, including surfaces like Playground, Model Garden, and Fine-Tuning. The ideal candidate is motivated by shipping impactful features that users value, working across the entire product lifecycle from data models to user interfaces. This is a high-ownership position on a fast-moving team where individual contributions are highly visible and directly influence product direction.

$160k - $230k