Human Annotation Jobs

Moveworks' AI agents are designed to act, plan, and modify enterprise systems, impacting millions of employees. This role focuses on building the "judgement layer" of our agent evaluation platform. You will develop the rubrics, judges, and calibration methods necessary to accurately score agent actions across multi-step trajectories. The goal is to create a reliable signal that not only measures performance but also serves as a reward mechanism for training agents. This is an applied ML role tackling the open research problem of LLMs judging LLMs, specifically applied to agents interacting with real-world enterprise environments.