Model Behavior Architect- Safety
Remote • Paris • Full-time
Posted 10mo ago
Job Location
Paris
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
LLM Engineer
About the job
As a Model Behavior Architect, you will be at the forefront of defining and measuring LLM behavior. We are seeking individuals with a background in engineering, machine learning, and large language models, who possess expertise in model evaluation, policy writing, and creating evaluation pipelines for complex tasks. Your role will involve close collaboration with our Science team to establish standards for Reasoning, Audio, Alignment, Tools, and other frontier initiatives. This is an opportunity to engage with cutting-edge, open-ended research challenges and translate your insights into superior models.
Responsibilities
- Interact with models to identify areas for behavioral improvement.
- Collect internal and external feedback on model behavior to define improvement scopes.
- Design and implement evaluations, data guidelines, data generation, and synthetic testing environments.
- Identify and resolve edge case behaviors through rigorous testing.
- Develop robust evaluation pipelines for model candidates.
- Collaborate with AI Scientists.
Requirements
- Deep understanding of linguistics, language, and translation, OR engineering and code behavior, OR LLM agents including reasoning and tool use.
- Prior experience in training and optimizing model behavior.
- Expertise in building robust evaluations.
- Ability to thrive in dynamic and technically complex environments.
- Proven track record of delivering innovative, out-of-the-box solutions to address real-world constraints.