Software Engineer - Voice AI (Inference Runtime)
Remote • San Francisco • FullTime
Posted 4mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Baseten is seeking a highly impactful individual to lead the Voice AI product area, owning the end-to-end development and implementation of their in-house inference stack for Voice AI models. This role involves partnering closely with various engineering teams to push the boundaries of Voice AI, making a significant impact on industries like productivity, customer service, and education. You will be responsible for bringing state-of-the-art open-source models into production, focusing on optimizing model serving for latency, throughput, and GPU efficiency, and building large-scale, real-time infrastructure for multi-model voice agents.
Responsibilities
- Own and lead Voice AI product areas end-to-end, from architecture and system design through implementation, rollout, and long-term production operations.
- Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments.
- Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery.
- Mentor teammates through code reviews, design docs, and technical leadership.
Requirements
- Bachelor's degree or higher in Computer Science or related field.
- Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
- Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.
- Good taste in product, particularly developer-oriented tools.
- Interest in ML/AI infrastructure and willingness to learn.
- Strong collaboration and communication skills.
- Comfortable using AI coding assistants (e.g., Claude Code, Codex, Cursor) as a daily productivity multiplier.
Benefits
- Competitive compensation, including meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.