Product Management, Human Data Platform
San Francisco, CA | New York City, NY
Posted 16d ago
About the job
Anthropic's Human Data Platform team is responsible for building systems that enhance our AI models by collecting crucial data. This involves creating infrastructure for simulating real-world environments and tasks, developing innovative interfaces for data vendors, and establishing pipelines for researchers to acquire high-quality data efficiently. As the real-world application of Claude expands, so does the need for sophisticated data collection tools. This role will collaborate closely with a fast-paced engineering team, contribute to strategic decision-making, and ensure investments are made in scalable tooling. The position requires working across research teams, data operations, and external vendors to translate insights into actionable product direction.
Responsibilities
- Define and own the product strategy for human data tooling, prioritizing labeling interfaces, infrastructure, data quality, and operational visibility.
- Collaborate with engineering to scope and rapidly deliver features in a dynamic prototyping environment.
- Gain a deep understanding of research and training methodologies to identify high-leverage tooling investments.
- Identify recurring needs and drive the development of reusable infrastructure for long-term efficiency.
- Observe crowd worker and vendor sessions to systematically identify and address pain points.
- Establish and monitor outcome-based KPIs, including time-to-launch for data collection projects, data quality scores, and impact on model evaluation.
Requirements
- Experience shipping products where deep understanding of technical constraints was necessary.
- Experience working directly with research teams, preferably in AI/ML contexts.
- Ability to effectively communicate with both crowdworkers about their workflows and research teams about data quality methodologies.
- Demonstrated ability to quickly learn and understand complex technical systems.
- Interest in human-AI interaction and designing experiences that elicit high-quality data.
- Experience building data collection tools, annotation platforms, or human-in-the-loop pipelines.
- Experience working with researchers as internal users or customers.
- Strong project management skills, including prioritization and cross-team communication.
- Intellectual curiosity, comfort with ambiguity, and a proactive learning approach.
- A founder mentality with a track record of shipping highly technical products.