Product Lead, AI/ML (Evals)
Remote • SF Office • FullTime
Posted 1mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Machine Learning Engineer
About the job
Abridge is seeking a Product Lead, AI/ML to drive product strategy and execution within Note Generation. This critical role focuses on the quality of AI-powered clinical notes, ensuring accuracy, personalization, and clinical utility. You will own a key part of our product strategy, working closely with engineering, ML, design, and clinical leaders to shape the roadmap for our note models and evaluation systems. The goal is to set the industry standard for responsible AI deployment in healthcare and enhance clinician trust and efficiency.
Responsibilities
- Drive AI product strategy and execution within Note Generation, shaping the roadmap for note models and evaluation.
- Contribute to the evaluation platform and measurement systems, including human annotation, LLM judges, and automated backtesting.
- Drive depth across specialties and clinical contexts, ensuring notes reflect clinical expectations and norms.
- Collaborate with engineering and ML on architecture, model iteration, evaluation methodologies, and system reliability.
- Partner with product design to define user control surfaces that leverage model outputs.
- Translate real-world feedback from customer-facing teams into the model development loop.
- Operate with a high bar for quality, speed, and accountability.
Requirements
- 5 to 8 years of product management experience with significant ownership of ML powered products or platform systems.
- Deep understanding of how to measure and improve model quality, including evaluation frameworks, annotation pipelines, and benchmark design.
- Strong technical fluency across ML, data pipelines, and distributed systems.
- Experience working closely with ML researchers and engineers to drive impact in production.
- Ability to balance long term architectural investments with near term quality improvements.
- Strong communication skills and the ability to translate complex technical concepts into clear decisions and narratives.
- A track record of delivering high quality products in domains where accuracy, reliability, and trust are paramount.
Benefits
- Flexible work hours
- Inclusive culture
- Ongoing learning opportunities