hybrid attention Jobs

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Their work integrates model training, inference algorithms, and serving systems, optimizing all three for reduced cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your solutions against realistic serving workloads, such as long-context and agentic traffic.

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Our work spans model training, inference algorithms, and serving systems, aiming to reduce generation cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your ideas against realistic serving workloads, such as long-context and agentic traffic. Projects are designed to address key research questions in speculative decoding, leading to faster generation on frontier models, drafters that adapt to changing workloads, and robust evaluation under real traffic.