Research Scientist, Takeoff Intel
San Francisco, CA
Posted 3d ago
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Anthropic is seeking a Research Scientist to focus on measuring and understanding recursive self-improvement in large models. The ideal candidate has hands-on research experience with large models, including pretraining, fine-tuning, reinforcement learning, evaluations, or agent scaffolds. You will leverage your understanding of the model development loop to identify key signals, design evaluations and models to measure them, and interpret the results to understand the pace of AI advancement. This role involves making research bets, owning outcomes, and communicating findings through written assessments for internal decision-makers and public reporting. Collaboration with various research and policy teams is expected.
Responsibilities
- Identify signals that track AI R&D acceleration and design corresponding evaluations.
- Build quantitative models of capability growth and self-improvement dynamics using evaluation and telemetry data.
- Conduct experiments and evaluations to test hypotheses about automation and capability.
- Make research decisions and take ownership of their outcomes.
- Write graded assessments of measurement results for internal and public use.
- Collaborate with pretraining, RL, economic research, and policy teams.
Requirements
- Hands-on research experience with large language models (pretraining, fine-tuning, RL, evals, or agent systems).
- Strong quantitative instincts and comfort with quantitative modeling and reasoning.
- Experience in forecasting, potentially with published AI forecasting scenarios.
- Ability to design evaluations from vague questions and defend methodologies.
- Clear and calibrated writing, including stating confidence levels and potential counterarguments.
- Motivation by impact, with a focus on assessments and system cards over papers.
- A strong interest in AI safety and understanding the implications of rapid capability growth.
Benefits
- Annual compensation range: $350,000 - $850,000 USD
- Visa sponsorship available
- Encouragement to apply even if not all qualifications are met
- Commitment to diversity and inclusion