ML Ops Infrastructure Engineer

$160k - $220k • Remote • USA - Remote • FullTime

Posted 6mo ago

Remote Work Policy

Fully remote

Employment Type

FullTime

Categories

Machine Learning Engineer

About the job

Deepgram is seeking an ML Ops Infrastructure Engineer to build the critical bridge between AI research and production. This role involves designing and implementing the pipelines, deployment systems, and testing infrastructure necessary to take models from experimental stages to battle-tested at scale. The goal is to ensure that model improvements are delivered safely, quickly, and reliably to customers relying on Deepgram's real-time voice AI APIs. The ideal candidate will be excited by the challenge of operationalizing cutting-edge AI models, believe in the value of great infrastructure, and enjoy designing automated, reliable, and self-healing systems.

Responsibilities

  • Design and build CI/CD pipelines for ML model development, validation, and deployment.
  • Architect and maintain model deployment pipelines from research to production.
  • Build A/B testing infrastructure for controlled model rollouts and performance measurement.
  • Implement comprehensive monitoring for model performance in production, including accuracy, latency, and drift.
  • Develop automated retraining pipelines triggered by data changes or performance degradation.
  • Create and maintain build and test environments that mirror production.
  • Establish model versioning, artifact management, and rollback capabilities.
  • Collaborate with research engineers to define and enforce model quality gates.
  • Build observability dashboards for real-time insight into model health.
  • Optimize model serving infrastructure for latency, throughput, and cost efficiency.

Requirements

  • 4+ years of experience in MLOps, DevOps, or infrastructure engineering with a focus on ML systems.
  • Strong proficiency in Python and experience building automation for ML workflows.
  • Deep experience with CI/CD systems for software and model delivery.
  • Hands-on experience with Docker and Kubernetes.
  • Practical experience deploying and serving ML models in production.
  • Familiarity with model evaluation, validation, and quality assurance processes.
  • Understanding of monitoring and observability principles for ML systems.
  • Strong problem-solving skills and a bias toward automation.

About Deepgram

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.