Human Judgment Jobs

Dscout is seeking an AI Research Engineer to join their new AI Training & Evals unit. This team focuses on building human data and evaluations to determine if AI performs effectively for real people in real-world contexts. While AI models may excel at benchmarks, they often surprise users in practice. This role bridges that gap by leveraging Dscout's decade of experience in capturing human behavior to create training data, evaluations, and benchmarks that AI teams can trust. The position offers a unique opportunity to work on unsolved problems in AI measurement, study real participants in their own context, and contribute to publishing novel methods and benchmarks.

$250k - $400k