Cyber Evaluations Engineer
San Francisco, CA | Washington, DC
Posted 12d ago
About the job
We are seeking Cyber Evaluations Engineers to develop and execute evaluations that assess the cyber-relevant capabilities and robustness of our AI models. In this role, you will design new evaluation methodologies, conduct per-release robustness testing, and analyze data related to jailbreaks and prompt bypasses to identify areas where our safeguards are effective and where they need improvement. You will also be responsible for designing probes to detect cyber abuse in production and collaborating with the policy team to shape the overall detection architecture.
Responsibilities
- Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models.
- Execute per-release safeguard-robustness testing ahead of major model launches.
- Analyze evaluation results and communicate findings clearly to the team and stakeholders.
- Design, prototype, and tune detection probes for cyber misuse.
- Collaborate with the cyber policy team to translate policy into a robust abuse-detection architecture and measure its effectiveness.
- Build and maintain internal tooling for running and scoring evaluations.
- Translate evaluation findings into safeguard improvements by working with policy and engineering partners.
Requirements
- Experience building or running evaluations, benchmarks, or test suites for software or ML systems, with a track record of delivering results on tight deadlines.
- Hands-on cybersecurity experience, such as CTF participation, vulnerability research, exploit development, or security research.
- Proficiency in Python.
- Strong ability to communicate evaluation results to cross-functional stakeholders and policy teams.
Benefits
- Annual compensation range: $300,000 - $405,000 USD
- Visa sponsorship available
- Hybrid work policy (at least 25% in office)