Safety Engineer (Data)
Salary not listed • London • Full-time
Posted 19d ago
About the job
We are seeking a Data Scientist to own the datasets and evaluation workflows crucial for our AI Safety initiatives. This role involves transforming real-world product data into well-structured datasets for model training and evaluation, and developing the processes and infrastructure to monitor model performance in production. You will collaborate with safety researchers, engineers, and policy specialists, translating complex safety requirements into practical data and evaluation systems. The work starts with hands-on data collection, analysis, and labeling, then progresses to building scalable methodologies, contributor networks, and quality standards.
Responsibilities
- Own safety datasets end-to-end, including collection, cleaning, labeling, quality control, versioning, and preparation for training and evaluation.
- Translate safety policy into clear, consistent labeling and evaluation criteria.
- Design and manage labeling processes, including sourcing, onboarding, and overseeing external contributors.
- Build evaluation workflows for production models to track performance and identify issues using real-world data.
- Develop Python/SQL pipelines and tooling to accelerate data work and ensure reproducibility, collaborating with ML engineers on data readiness.
Requirements
- Experience as a Data Scientist or in a similar role, working with real-world datasets and ML models.
- Strong understanding of dataset best practices: collection, cleaning, sampling, labeling, quality control, and evaluation.
- Proficiency in Python and SQL for data analysis and workflow development.
- Excellent critical thinking and judgment, with the ability to handle ambiguity and translate complex guidelines into scalable decisions.
- Autonomous and clear communicator, capable of working across disciplines in a fast-paced environment.
Benefits
- Innovative culture
- Growth paths
- Learning & development stipend
- Social travel stipend
- Annual team offsite
- Co-working stipend