Member of Technical Staff - RL Environments
Remote • London • FullTime
Posted 19h ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Cohere is seeking a Member of Technical Staff to focus on Reinforcement Learning (RL) Environments. In this role, you will be instrumental in building and refining the AI agents that power enterprise solutions. This involves creating realistic work environments, populating them with challenging tasks, and defining clear reward mechanisms. Your work will directly contribute to the evaluation and training of these agents, with customer feedback closing the loop for continuous improvement. You will collaborate across teams to identify performance gaps and enhance both agents and environments, ensuring the delivery of cutting-edge AI capabilities to our clients.
Responsibilities
- Build new RL environments for different agent capabilities and industries.
- Train and evaluate AI agents within these environments.
- Integrate tasks, data, tool implementations, and verifiers.
- Collaborate with modeling and product teams to improve agents and environments based on performance gaps.
- Work with external vendors to create high-quality RL environments and build tools for quality assurance.
- Automate the identification of model capability gaps and systematically measure agent performance.
Requirements
- Experience engineering and optimizing agents for specific industry use cases.
- Experience reviewing agent trajectories to identify and fix failure points.
- Experience measuring agentic capabilities and establishing repeatable processes.
- Experience translating desired AI agent outcomes into verifier implementations and reward designs.
- Experience designing and running annotation workflows for agent performance insights and data quality verification.
- Experience building synthetic data pipelines for scaling evaluation and training.
- Experience using agents in daily work and improving personal productivity setups.
- Experience with training with RL, including scaling, troubleshooting, and tuning environments (a plus).
Benefits
- Weekly lunch stipend of $75/£75 or equivalent.
- Full health and dental benefits with a mental health budget.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months.
- Annual enrichment benefits (arts & culture, fitness/wellness, quality time, workspace improvement).
- Education & learning stipend for conferences, courses, and coaching.
- 6 weeks (30 working days) of paid vacation.
- Budget for traveling to other offices for remote employees.
- Annual company offsite.
- Co-working benefit for those not near an office.
- $500 home office stipend.