Audio Inference Engineer, Model Efficiency
Remote • New York • FullTime
Posted 8mo ago
Job Location
New York
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Cohere is seeking an Audio Inference Engineer focused on Model Efficiency to join a fast-growing team of researchers and engineers. The mission of this team is to build reliable machine learning systems and optimize audio inference serving efficiency using innovative techniques. As an engineer on this team, you will advance core audio model serving metrics, including latency, throughput, and quality by diving deep into systems, identifying bottlenecks, and delivering creative solutions for audio processing and streaming workloads. You will collaborate closely with both the training and serving infrastructure teams to ensure seamless integration between model development and deployment, with a special focus on real-time and streaming audio inference.
Responsibilities
- Advance core audio model serving metrics (latency, throughput, quality).
- Identify system bottlenecks and deliver creative solutions for audio processing and streaming workloads.
- Collaborate with training and serving infrastructure teams for seamless integration.
- Focus on real-time and streaming audio inference.
Requirements
- Significant experience developing high-performance audio or machine learning inference systems.
- Proficiency in C++ and Python.
- Hands-on experience with deep learning models for audio, speech, or language applications.
- A bias for action and a strong results-oriented mindset.
Benefits
- Weekly lunch stipend of $75/£75 or equivalent.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (Arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days).
- Budget for traveling to other offices if remote.
- Annual company offsite.
- $500 home office stipend.