Software Engineer - Applied AI (Senior or Staff Level)
$197k - $307k • Remote • San Francisco, CA • FullTime
Posted 3mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Deepgram is seeking an engineer to join its Applied AI team, focused on tackling complex voice AI challenges for enterprise clients. This role involves working directly with major companies to solve unique problems that lack off-the-shelf solutions, often involving "zero to one" innovation. Current projects include developing robust ASR for noisy environments, enabling self-service model adaptation for large customers, building high-accuracy voice agents for specific domains like drive-thru ordering, and enhancing real-time analytics and on-site hardware integration. The company fosters an AI-first culture where all team members are expected to actively use, experiment with, and build AI tools into their daily work, adapting quickly to the rapid pace of AI advancements.
Responsibilities
- Design, develop, and maintain scalable, high-performance backend systems for the platform.
- Improve speech-to-text and text-to-speech quality across various environments.
- Expand robust scoring and evaluation of voice agents.
- Fine-tune and adapt AI models for customer-specific vocabulary and domains.
- Optimize the AI pipeline for challenging audio environments, ambiguous requests, and rapid scaling.
- Run experiments to validate the product impact of new functionality.
- Collaborate with the team to ensure seamless integration between ML models, backend, and client devices.
Requirements
- 4+ years of hands-on experience in developing, implementing, and maintaining cloud infrastructure in production.
- Hands-on applied AI/ML experience beyond using LLMs, including training, fine-tuning, or adapting models.
- Experience evaluating AI systems, such as building evaluation or scoring for models or agents.
- Excellent problem-solving skills and adaptability to a rapidly evolving startup environment.
- Strong communication and collaboration skills.
- Willingness to problem-solve across the entire product.
- Ability to proactively identify problems and propose solutions.
- Results-oriented with a focus on work impact.
- Experience working with audio (preferred).
- Experience with speech-to-text or text-to-speech models (preferred).
- Applied research experience or background as a research engineer (preferred).
- Experience taking a system from zero to one (preferred).
- Experience building and maintaining systems integrating with 3rd party APIs, especially Point of Sale systems (preferred).
- Experience with Python, Kotlin, or TypeScript (preferred).
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field (preferred).