ML Ops Infrastructure Engineer
$160k - $220k • Remote • USA - Remote • FullTime
Posted 6mo ago
Job Location
USA - Remote
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Deepgram is seeking an ML Ops Infrastructure Engineer to build the critical bridge between AI research and production. This role involves designing and implementing the pipelines, deployment systems, and testing infrastructure necessary to take models from experimental stages to battle-tested at scale. The goal is to ensure that model improvements are delivered safely, quickly, and reliably to customers relying on Deepgram's real-time voice AI APIs. The ideal candidate will be excited by the challenge of operationalizing cutting-edge AI models, believe in the value of great infrastructure, and enjoy designing automated, reliable, and self-healing systems.
Responsibilities
- Design and build CI/CD pipelines for ML model development, validation, and deployment.
- Architect and maintain model deployment pipelines from research to production.
- Build A/B testing infrastructure for controlled model rollouts and performance measurement.
- Implement comprehensive monitoring for model performance in production, including accuracy, latency, and drift.
- Develop automated retraining pipelines triggered by data changes or performance degradation.
- Create and maintain build and test environments that mirror production.
- Establish model versioning, artifact management, and rollback capabilities.
- Collaborate with research engineers to define and enforce model quality gates.
- Build observability dashboards for real-time insight into model health.
- Optimize model serving infrastructure for latency, throughput, and cost efficiency.
Requirements
- 4+ years of experience in MLOps, DevOps, or infrastructure engineering with a focus on ML systems.
- Strong proficiency in Python and experience building automation for ML workflows.
- Deep experience with CI/CD systems for software and model delivery.
- Hands-on experience with Docker and Kubernetes.
- Practical experience deploying and serving ML models in production.
- Familiarity with model evaluation, validation, and quality assurance processes.
- Understanding of monitoring and observability principles for ML systems.
- Strong problem-solving skills and a bias toward automation.