Senior Machine Learning Platform Engineer
$148k - $222k • Boston, MA • Full-time
Posted 9d ago
About the job
Klaviyo is building state-of-the-art AI and machine learning technologies to power its products, focusing on software that can run and optimize itself based on outcome or reward metrics. As a Senior Machine Learning Platform Engineer, you will be instrumental in building the core platforms, tools, and infrastructure that ML and AI engineers rely on to create advanced agents and models. This backend-heavy, hands-on role involves driving key technical initiatives for training and deploying models, standardizing feature data, and scaling systems to operate reliably at Klaviyo's data and traffic scale. You will lead technical execution, conduct code and design reviews, author high-impact code, and collaborate with product, ML, data science, and infrastructure partners to deliver durable platforms that accelerate AI development.
Responsibilities
- Enable AI/ML teams to ship new models and ML-powered features faster, more safely, and more reliably.
- Evolve the ML and LLM platform architecture for building, evaluating, and operating production ML systems.
- Improve reliability, observability, and cost efficiency of ML training, inference, and other ML workloads.
- Raise the bar on engineering and operational excellence for systems supporting a large customer base and billions of events.
- Architect and scale systems supporting feature storage and real-time retrieval for training and inference datasets.
- Design seamless workflows for continuous model training, inference, and monitoring with AI & ML application teams.
- Lead technical execution, conduct code and design reviews, and author high-impact code for critical system paths.
- Mentor engineers across the organization on engineering excellence, best practices, and design standards.
- Drive architectural design and technical direction for core components of the ML and Feature platforms.
- Partner with product and engineering leaders to define the ML Platform roadmap.
Requirements
- 7+ years of experience as a software engineer, ML platform engineer, or similar, building backend or distributed systems.
- Demonstrated experience designing and launching AI/ML systems in production at scale.
- Strong proficiency in Python (or a similar backend language such as Go, Java, or Scala).
- Experience with cloud infrastructure and platform fundamentals (AWS, Kubernetes).
- Familiarity with data-intensive systems: streaming or batch processing, data modeling, and designing systems with large-scale data in mind (Spark, Ray Data).
- Comfortable collaborating with cross-functional technical partners (ML, product, infra, security).
- Strong communication skills and a track record of driving technical excellence across teams.