Research Engineer, Audio and Speech

About the job

Responsibilities

• Design and build next-generation agent harnesses optimized for streaming speech, turn-taking, interruptions, overlapping speech, and continuous interaction.
• Research and train multimodal and full-duplex models that jointly understand audio, reason, and generate speech.
• Improve speech recognition, voice activity detection, endpointing, and speech generation across diverse speakers, environments, domains, and languages.
• Build evaluations and use production calls to ship measurable improvements in accuracy, latency, naturalness, and task outcomes.
• Optimize end-to-end inference for responsiveness, throughput, stability, and cost, partnering with Voice Platform and Infrastructure teams to deploy at scale.

Requirements

• 2+ years of experience in speech, audio ML, multimodal ML, or production machine learning.
• Experience developing or adapting autoregressive, diffusion, flow-matching, or codec-based speech models.
• Hands-on experience with streaming agent systems, low-latency inference, production model serving, and evaluation on real-world audio.
• Fluency in Python and a modern deep-learning framework such as PyTorch.
• Strong foundations in machine learning and signal processing.
• A track record of taking research ideas from prototype to reliable, measurable production impact.
• Familiarity with speech-to-speech or full-duplex models.
• Experience with telephony, multilingual speech, noisy-channel robustness, speaker adaptation, or expressive speech generation.

Benefits

• Equity
• Medical, Dental, and Vision benefits for you and your family
• Life Insurance and Disability Benefits
• Retirement Plan (e.g., 401K, pension)
• Parental Leave
• Fertility and family building benefits through Carrot
• Monthly stipend to support your wellness, lifestyle, and work-life balance
• Daily lunches and snacks in the office
• Take what you need vacation policy