Data Scientist
San Francisco • FullTime
Posted 1y ago
About the job
Mercor is a leading AI data company building the layer between human expertise and frontier models. Millions of domain experts are paid to train frontier AI models, and Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this infrastructure to Fortune 500 companies, helping them capture how their best people work and translate that expertise into agents. The company is creating a new category of work where expertise powers AI advancement, requiring an ambitious, fast-paced, and deeply committed team working alongside researchers, operators, and AI companies at the forefront of shaping systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion.
Responsibilities
- Define north-star and feature-level metrics for ranking, interview analytics, and payouts systems.
- Design and run A/B tests and quasi-experiments, translating results into product decisions.
- Build source-of-truth dashboards and lightweight data models for self-service analytics.
- Instrument events with engineers to improve data quality and latency.
- Prototype quick models to improve matching and scoring.
- Help evaluate LLM-powered agents by designing rubrics, human-in-the-loop studies, and guardrail canaries.
Requirements
- 0-2 years in data science/analytics or similar.
- BS/BA in a quantitative field or equivalent work experience.
- Strong SQL skills.
- Proficiency in Python for analysis.
- Comfort with experiment design and causal thinking.
- Ability to communicate crisply with engineers, PMs, and leadership.
- Ability to turn analysis into action.
Benefits
- Bi-annual performance bonus structure
- Generous equity grant vested over 4 years
- Up to $15k Relocation bonus
- $10K housing bonus (if living within 0.5 miles of office)
- $1.5K monthly stipend for meals
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, Dental, Vision insurance