Research Engineer (General)
$100k - $230k • Remote • San Francisco • FullTime
Posted 5mo ago
About the job
HUD is building reliable, fair, and open infrastructure for AI data, aiming to make data valuable for creators and trustworthy for AI training labs. As a growing team backed by significant VC funding, we are developing a marketplace and platform used by startups, Fortune 500 companies, and frontier labs. This role is for Research Engineers focused on building the technical foundation for training and evaluating frontier AI agents. You will be instrumental in creating new environments, enhancing data quality, and translating real-world workflows into tasks and benchmarks.
Responsibilities
- Build systems for creating, running, evaluating, and improving agent training environments.
- Design experiments to understand model behavior, agent failure modes, and data quality issues.
- Develop tools to assist researchers, engineers, and data vendors in creating higher-quality tasks, trajectories, and feedback loops.
- Manage the full lifecycle of agent training data, including task design, environment setup, trajectory collection, evaluation, and validation.
- Collaborate with external vendors to identify bottlenecks and improve data engine quality and throughput.
- Develop metrics and analyses to assess the utility of tasks, environments, and evaluations for training frontier agents.
Requirements
- Proficiency in Python, Docker, and Linux environments.
- Experience with benchmarks and evaluations, understanding task realism, rubric reliability, environment usability, and trajectory usefulness for RL training.
- Strong attention to detail for identifying subtle inconsistencies in data, model behavior, or task design.
- Experience building tools, pipelines, experiments, or infrastructure without a fully defined roadmap.
- Ability to work independently in fast-paced startup environments.
- Strong communication skills for remote collaboration across time zones.
Benefits
- Competitive compensation
- 100% covered top-of-the-line medical, dental, and vision (US and Singapore employees)
- Lunch and dinner for in-office employees
- Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
- Equinox membership (US employees)
- 401k (US employees)
- Commuter benefits (US employees)
- Health/wellness stipend (Singapore employees)
- Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
- Annual travel budget to visit either office