Together AI

Together AI

Together AI's Model Shaping team focuses on tailoring open foundation models for downstream applications, building services that help ML developers select and improve models with domain-specific data. The team also develops efficient model training and evaluation methods, drawing from machine learning, NLP, and ML systems. As a Research Engineer, you will develop a platform for users to customize open-source models with their own data, working across training and inference stacks. You will build and enhance services for Fine-Tuning, Reinforcement Learning, and Evaluation, ensuring a smooth transition from post-training to production serving and optimizing inference engines for RL training. Collaboration with product, research, and engineering teams is key to maintaining API reliability and performance, ultimately contributing to the foundational layer of the open-source AI ecosystem.

$200k - $290k

Together AI

Together AI runs one of the largest GPU fleets globally, and the Infra Agent Systems team is responsible for developing the software that powers and automates this infrastructure. The team builds production AI agents designed to diagnose hardware failures, investigate incidents, correlate signals across the fleet, and automate operational workflows. Alongside these agents, they are building the core platform, which includes knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling. This role offers the unique opportunity to work at the intersection of AI agents, distributed systems, infrastructure, and automation, tackling complex engineering challenges with significant real-world impact.

$250k - $300k

Together AI

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. The AI Infrastructure team is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.

$200k - $280k

Together AI

As a Systems Research Engineer Intern specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. You will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems, and contribute to the co-design of efficient GPU architectures and programming models. Your research skills will be vital in staying up-to-date with the latest advancements in GPU programming techniques, ensuring that our AI infrastructure remains at the forefront of innovation.

$121k - $146k

Together AI

The Agents team focuses on building, aligning, and scaling advanced AI systems capable of handling complex, multi-step tasks and workflows across text and speech, particularly in agentic and scientific domains. This role sits at the intersection of agent capabilities, human-computer interaction, and infrastructure, exploring areas like post-training methods for agentic behavior and evaluation frameworks for open-ended tasks. As a research intern, you will contribute to cutting-edge agentic AI challenges, addressing issues of alignment, reliability, and scalability. Projects may involve developing new training techniques for self-learning and long-horizon reasoning, curating datasets for scientific and agentic tasks, analyzing agentic behavior failure modes, or building scalable agent operation infrastructure.

Together AI

The Agents team investigates how to build, align, and scale frontier AI systems capable of complex, multi-step tasks across text and speech, focusing on agentic and scientific domains. This role sits at the intersection of agent capabilities, human-computer interaction, and infrastructure, exploring areas like post-training methods for agentic behavior and evaluation frameworks for open-ended tasks. As a research intern, you will tackle challenges in alignment, reliability, and scalability, potentially working on new training recipes for self-learning, curating datasets for non-deterministic tasks, studying agentic behavior failure modes, or building large-scale agent operation infrastructure.

Together AI

At Together AI, you will build and operate one of the world's largest GPU fleets for frontier model training and inference. This role is for engineers who excel at building systems, automating processes, and solving problems at a massive scale. If you prefer writing software over manual operations and aim to build infrastructure that autonomously manages tens of thousands of GPUs, we encourage you to apply.

$190k - $270k

Together AI

The Model Shaping team at Together AI focuses on tailoring open foundation models for downstream applications, building services that help machine learning developers select and improve models with domain-specific data. We also develop novel methods for efficient model training and evaluation, drawing from machine learning, natural language processing, and ML systems. As a Research Engineer on the Scaling Team, you will translate cutting-edge research in efficient foundation model training into robust, high-performance systems. You will optimize Together's training infrastructure, identify performance bottlenecks, and implement state-of-the-art techniques in production environments. Your work will directly influence the fine-tuning experience for Together's customers. You will integrate newly released open-source models onto the platform, ensuring efficient and reliable training across diverse workloads. Collaborating with Research Scientists, you will build experimental infrastructure to accelerate research and deploy validated ideas at scale.

$200k - $290k

Together AI

The Model Shaping team at Together AI focuses on products and research for tailoring open foundation models to downstream applications. We build services that enable machine learning developers to select optimal models for their tasks and enhance them with domain-specific data. Additionally, we develop novel methods for efficient model training and evaluation, drawing from diverse ideas in machine learning, natural language processing, and ML systems. As a Platform Engineer in this team, you will operate at the intersection of backend engineering and infrastructure, developing the core layers of Together’s platform for model customization and evaluation. Your role will involve designing, developing, and maintaining the backend services and underlying systems necessary for sustainably and reliably scaling production workflows for users and internal research experiments. You will collaborate cross-functionally with other engineers and researchers to enhance infrastructure based on project needs and integrate services with other engineering teams at Together.

$200k - $290k

Together AI

Together AI is seeking a Manager to oversee commercial relationships with international cloud compute suppliers and develop market intelligence to guide compute supply strategy. This role involves managing the entire lifecycle of international cloud service provider (CSP) contracts and renewals, conducting RFPs for new capacity, establishing global GPU cloud pricing benchmarks, and collaborating with infrastructure engineering, finance, and go-to-market teams to ensure optimal capacity and economics during rapid global GPU fleet expansion.

$190k - $220k

Together AI

As a Customer Success Engineer at Together AI, you will be the named technical owner for one of our most strategic customer relationships. You will serve as the primary technical point of contact across all infrastructure domains, including compute, networking, storage, and facilities, ensuring the flawless delivery and operational health of large-scale GPU deployments. This role is crucial for driving both customer success and company growth by combining deep infrastructure expertise with high-stakes customer partnerships.

$260k - $290k

Together AI

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware and enables state-of-the-art ML practitioners with self-serve AI cloud services. This platform serves both internal StaaS products and external cloud customers across dozens of data centers worldwide.

$160k - $230k

Together AI

Together AI is building the Inference Platform to deliver advanced generative AI models, powering multi-tenant serverless workloads and dedicated endpoints. This platform enables developers, enterprises, and researchers to utilize the latest LLMs and multimodal models at scale. The role focuses on optimizing latency and maximizing the utilization of tens of thousands of GPUs. You will collaborate directly with research teams to productionize frontier models and engage with the open-source community, contributing to and leveraging projects like SGLang and vLLM to enhance inference performance and efficiency.

$200k - $290k

Together AI

As a Systems Research Engineer specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. You will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems, and contribute to the co-design of efficient GPU architectures and programming models. Your research skills will be vital in staying up-to-date with the latest advancements in GPU programming techniques, ensuring that our AI infrastructure remains at the forefront of innovation.

$200k - $300k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering production-grade, real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Staff ML Engineer to lead the model serving layer for voice workloads. This role involves hands-on optimization of inference engines and models, profiling GPU utilization, designing batching strategies for streaming audio, and ensuring rapid deployment of new model architectures from research to production. This is a foundational hire on a small, high-impact team, addressing the unique challenges of voice inference such as streaming audio, tokenization, and real-time latency budgets, and shaping the future of voice model serving.

$220k - $280k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Senior ML Engineer to lead the model serving layer for voice workloads. You will optimize inference engines like TRT-LLM and SGLang to serve models such as Whisper, Parakeet, Orpheus, and Kokoro, focusing on pushing latency and throughput boundaries. This role involves profiling GPU utilization, designing batching strategies for streaming audio, and accelerating the transition of new model architectures from research to production. As a foundational hire on a small, high-impact team, you will address the unique challenges of voice inference, including streaming audio, real-time latency, and tokenization, shaping how Together serves voice models as the industry moves towards end-to-end speech-to-speech systems.

$200k - $260k

Together AI

Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems. This role involves working with state-of-the-art large language models and ensuring they run efficiently and effectively at scale. You will have the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions and shape the future of AI inference.

$200k - $300k

Together AI

As a Systems Research Engineer Intern specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. You will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems, and contribute to the co-design of efficient GPU architectures and programming models. Your research skills will be vital in staying up-to-date with the latest advancements in GPU programming techniques, ensuring that our AI infrastructure remains at the forefront of innovation. This internship is based on-site at our San Francisco HQ, running through the Winter term from January to April.