knowledge distillation Jobs

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Their work integrates model training, inference algorithms, and serving systems, optimizing all three for reduced cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your solutions against realistic serving workloads, such as long-context and agentic traffic.

Together AI

The Speculative Decoding team at Together AI focuses on developing draft models and algorithms to accelerate large language model generation without altering outputs. Our work spans model training, inference algorithms, and serving systems, aiming to reduce generation cost and latency. As a research intern, you will explore open questions in speculative decoding, including new drafter architectures, verification schemes, knowledge distillation, and adaptive drafters. You will train and fine-tune draft models at scale on GPU clusters and evaluate your ideas against realistic serving workloads, such as long-context and agentic traffic. Projects are designed to address key research questions in speculative decoding, leading to faster generation on frontier models, drafters that adapt to changing workloads, and robust evaluation under real traffic.

Tavus is building the human layer of AI, aiming to make human-AI interaction as natural as face-to-face communication. We pioneer research in multimodal AI for modeling human communication (language, audio, video) and generating audio-visual avatar behavior, powering applications from text-to-video avatars to real-time conversational video. We are a Series B company backed by top investors, seeking individuals who thrive in startup environments, can prioritize independently, and are willing to take calculated risks to help pave the path forward.