Member of Technical Staff, Coding Agents
$200k - $350k • San Francisco, CA • FullTime
Posted 8d ago
Job Location
San Francisco, CA
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Handshake is seeking a Member of Technical Staff to define how frontier coding agents are benchmarked and improved. This is a high-ownership role for researchers who build, partnering with top AI researchers and software engineers to develop new benchmarks, reward and verifier systems, agent-evaluation methodologies, and data-quality techniques focused on AI for Coding. You will tackle core questions in frontier AI progress, including what to measure, how to design effective evaluations, create high-signal feedback, and build actionable data systems. As an early member, you will have significant influence over the team's technical direction, operating culture, and the open-source software, benchmarks, and research products developed.
Responsibilities
- Create and publish coding benchmarks that challenge state-of-the-art frontier agents.
- Understand and shape the frontier of coding agents, publishing studies of impactful findings.
- Assist top AI Labs in improving their coding models.
- Contribute publicly to the field through benchmarks, open-source tools, research, and technical writing.
Requirements
- Passion for building software with agents and tinkering with the latest coding agents.
- Comfort operating in an ambiguous, fast-moving environment with substantial ownership.
- Previous experience working on a coding benchmark.
- Published research on AI for Software / Code-Generation at top AI conferences (NeurIPS, ICLR, ICML, COLM).
- Extensive software engineering experience or strong GitHub profile of OSS contributions, with deep knowledge of agent harnesses.
Benefits
- Equity in a fast-growing company
- 401(k) match
- Competitive compensation
- Financial coaching
- Paid parental leave
- Fertility benefits
- Parental coaching
- Medical, dental, and vision insurance
- Mental health support
- $500 wellness stipend
- $2,000 learning stipend
- Ongoing development opportunities
- Commuting support
- Free lunch
- Gym in SF office
- Flexible PTO
- 15 holidays + 2 flex days
- Team outings
- Referral bonuses