Research Engineer, Synthetic Data
$100k - $230k • Remote • San Francisco • FullTime
Posted 3mo ago
About the job
HUD is building reliable, fair, and open infrastructure for AI data, aiming to create a valuable and trustworthy data economy for AI. We are seeking Research Engineers to develop our synthetic data pipeline. In this role, you will transform domain-specific workflows into realistic, scalable, and capability-expanding synthetic training tasks for AI agents. This involves creating tasks that are realistic enough to teach useful behavior, structured for large-scale generation, and challenging enough to push model boundaries.
Responsibilities
- Collaborate with subject-matter experts to create synthetic tasks for training AI agents across various professional and technical domains.
- Design methods for generating diverse, realistic, and learnable synthetic tasks.
- Develop systems and tools for mutating, validating, and enhancing synthetic tasks.
- Analyze model and agent performance on synthetic tasks to understand their learning outcomes and limitations.
- Create metrics to quantify and analyze synthetic task diversity, realism, and learnability.
Requirements
- Proficiency in Python, Docker, and Linux environments.
- Experience with synthetic data research methods.
- Strong understanding of the characteristics and limitations of effective synthetic data.
- Experience building synthetic data pipelines end-to-end without a predefined roadmap.
- Experience working with environments, evaluations, and benchmarks.
- Detail-oriented with the ability to identify subtle inconsistencies or edge cases in synthetic data.
- Ability to reason from first principles about task design, scoring, and failure modes.
- Thrives in unstructured problem spaces.
- Early-stage startup experience with the ability to work independently in fast-paced environments.
- Strong communication skills for remote collaboration across time zones.
Benefits
- Competitive compensation
- 100% covered top-of-the-line medical, dental, and vision (US and Singapore employees)
- Lunch and dinner for in-office employees
- Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
- Equinox membership
- 401k
- Commuter benefits (US employees)
- Health/wellness stipend (Singapore employees)
- Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
- Annual travel budget to visit either office