Machine Learning Infra Engineer
$200k - $300k • San Francisco Office • FullTime
Posted 5mo ago
Job Location
San Francisco Office
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Reducto is seeking an ML Infra Engineer to build and maintain the inference and training frameworks that enable enterprise-grade AI performance at scale. This role involves close collaboration with ML and Platform teams to scale training across nodes, develop efficient serving solutions, and implement robust observability across the stack. You will play a key part in defining high-performance ML training and inference at Reducto, a rapidly growing company backed by significant funding and serving leading AI teams and enterprise clients.
Responsibilities
- Build and maintain the training and inference stack for fast iteration and high performance.
- Develop benchmarks to identify bottlenecks in training and inference stacks.
- Explore and apply state-of-the-art advances in training and inference.
- Design systems for scaling multi-node, multi-GPU model training with reliability and observability.
- Scale distributed training and inference workloads across large GPU clusters, improving utilization, reliability, and cost efficiency.
- Build tooling, abstractions, and observability to accelerate ML engineers' transition from experiment to production.
Requirements
- Strong Python skills and a background in systems engineering.
- Comfort with Kubernetes and distributed training frameworks.
- 3+ years of experience.
- Ability to hold oneself to a high bar for quality and precision.
- Enjoyment of solving complex problems and building from first principles.
- Comfort with real-world implementation challenges.
- Ability to operate well in fast-changing, high-growth environments.
- Effective collaboration across technical and non-technical teams.
- Full ownership from strategy through execution.
Benefits
- Unlimited PTO
- Daily free lunch at the office
- Reimbursed transportation
- Generous health insurance (medical, dental, vision)
- $150/month health and wellness budget
- Flexible parental leave