Senior ML Ops Engineer
$210k - $300k • NYC Office • FullTime
Posted 2d ago
About the job
Confido is seeking a Senior ML Ops Engineer to be the first dedicated owner of its ML platform. This role will be responsible for the pipelines, serving, and cloud foundation that enable AI/ML models and agents to operate reliably and cost-efficiently in production. The engineer will ensure the platform can handle large-scale workloads, including document understanding, forecasting, and agentic systems, with a focus on making AI/ML development and deployment seamless for the AI/ML team.
Responsibilities
- Own ML pipelines end-to-end, from experimentation to production, including infrastructure for training, inference, and agentic workloads.
- Provide a streamlined development path for the AI/ML team, enabling reproducible environments and rapid deployment of new models and agents.
- Establish cloud infrastructure as code and implement CI/CD processes for safe ML deployment.
- Optimize inference and forecasting workloads for latency, throughput, and cost, including data stream management.
- Manage the data interface with data engineering, ensuring models receive the correct data and their outputs are integrated back into the platform.
- Implement and maintain reliability, observability, security, and privacy standards, ensuring model and agent quality is measurable through online evaluations and human-in-the-loop review.
Requirements
- 5+ years of experience in MLOps, ML platform, AI infrastructure, or platform engineering with production ML systems.
- Proficiency in both software development and cloud infrastructure management.
- Proven experience driving a full ML pipeline from conception to production, including understanding architecture, security, and cost trade-offs.
- Deep understanding of cloud infrastructure, distributed data systems, and Infrastructure as Code (IaC).
- Strong Python skills and experience with production application codebases (Ruby, Java).
- High degree of ownership in a fast-paced startup environment.
- Experience productionizing work from research or AI teams.
Benefits
- Equity ownership
- Fully paid health coverage (Aetna)
- Top-tier dental and vision coverage (Guardian)
- Carrot Fertility Pro support
- 12 weeks of paid parental leave
- Unlimited PTO
- 401(k) through Vestwell
- Paid relocation support to NYC
- Fully equipped workspace (laptop, monitor, keyboard)
- Stipend for workspace personalization
- Team perks (catered lunches, team dinners, unlimited coffee/snacks)