Product Manager, Claude Code Model Performance
San Francisco, CA | Seattle, WA
Posted 16d ago
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
As a Product Manager on Claude Code's model performance team, you will drive model launches end-to-end, build evals that measure what matters, and partner directly with researchers and product engineers to translate model improvements into developer-facing outcomes. Claude Code is the most capable coding agent in the world, and this role is crucial for extracting its maximum performance. You will act as the connective tissue between frontier research and the millions of developers who depend on Claude Code.
Responsibilities
- Own model launch planning and execution for Claude Code, defining readiness criteria and coordinating across teams.
- Design and implement agentic evals to measure real-world coding performance.
- Drive the engineering team's eval roadmap.
- Partner with researchers to define target behaviors and influence model development.
- Analyze user transcripts to understand capability gaps and translate research progress into shipped improvements.
- Synthesize signal from internal users, external developers, and competitive benchmarks into clear priorities.
Requirements
- Personally built agentic evals (e.g. SWE-bench-style task suites).
- Daily Claude Code user with ability to articulate desired model changes.
- Engineering background and 2+ years in product management, or equivalent experience driving product direction as an engineer.
- Deep grasp of AI concepts, model behavior, prompt engineering, and evaluation methodology.
- Systems thinker capable of building infrastructure to prevent recurring problems.
- Experience launching products or capabilities in ambiguous, research-adjacent environments.
- Creative, hacker spirit with a love for solving puzzles.
Benefits
- Annual compensation range: $305,000 - $460,000 USD
- Visa sponsorship available for some roles and candidates.