Senior Member of Technical Staff, Safety and Security for Agents
Remote • London • FullTime
Posted 4mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Cohere is seeking a Senior Member of Technical Staff to join the Safety and Security for Agents team. In this role, you will significantly contribute to the development of safer, fairer, more trustworthy, and more secure Large Language Models (LLMs). Your work will focus on data generation, post-training algorithms, and evaluation methods to ensure the safety of next-generation models that interact with external resources and take actions. You will collaborate closely with machine learning teams, data annotation teams, and product and policy teams, requiring a blend of machine learning expertise, ethical AI principles, experimental design, and data management skills. This position offers significant autonomy and decision-making power within a small team, with the opportunity to shape the future of LLMs for societal benefit.
Responsibilities
- Focus on data generation for LLMs.
- Develop and implement post-training algorithms for LLM safety.
- Design and execute evaluation methods to ensure LLM safety and security.
- Collaborate with cross-functional machine learning, data annotation, product, and policy teams.
- Tackle novel scientific problems related to AI safety.
- Engineer solutions for testing and improving LLM safety.
- Analyze datasets for quality, biases, and suitability for training ML models.
- Evaluate and improve the generalizability and robustness of ML systems.
Requirements
- Strong statistical skills and experience evaluating scientific experiments.
- Extremely strong software engineering skills.
- Expertise in designing and conducting data collection tasks, including working with human annotators.
- Hands-on experience training large language models (LLMs) on distributed training infrastructures.
- Proficiency in programming languages such as Python.
- Experience with ML frameworks like PyTorch, TensorFlow, or JAX.
- Excellent communication skills for cross-functional collaboration.
- Publication record at top-tier AI/ML venues.
Benefits
- Weekly lunch stipend of $75/£75 or equivalent.
- Full health and dental benefits, including a mental health budget.
- RRSP matching, 401K, or Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks (30 working days) of paid vacation.
- Budget for traveling to other offices.
- Annual company offsite.
- $500 home office stipend.