Delivery Engineer
$100k - $225k • Remote • San Francisco • FullTime
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Engineer
About the job
HUD is seeking a Delivery Engineer to manage complex, time-sensitive data and evaluation programs for leading AI labs, data vendors, and internal teams. This role involves transforming ambiguous technical requirements into actionable plans, coordinating resources, and ensuring the quality and utility of data for evaluating and enhancing LLMs and agents. You will also be responsible for vendor management and developing processes and tools to support scalable and reliable delivery.
This position offers the opportunity to work on critical AI infrastructure, backed by significant VC funding and a growing team of accomplished researchers and engineers. You will play a key part in shaping the future of AI by ensuring data integrity and facilitating effective model development.
Responsibilities
- Own data and evaluation programs end-to-end, from scoping to delivery and retrospective.
- Translate ambiguous requests into clear specifications with defined milestones, owners, and dependencies.
- Maintain and improve data quality procedures using quantitative and qualitative analysis.
- Manage and improve delivery pipelines, including external vendor oversight.
- Streamline data production and evaluation logistics through workflow improvements, documentation, and automation.
- Partner with research, platform, and marketplace teams to drive product improvements based on learnings.
Requirements
- Experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, or a similar cross-functional role.
- Strong quantitative and qualitative judgment regarding data utility, reliability, and representativeness.
- Experience maintaining and improving complex processes, particularly in project delivery or data contexts.
- Demonstrated ability to structure ambiguous problems, adapt to changing requirements, and make sound tradeoffs.
- Strong written and verbal communication skills for translating technical information into clear actions.
- Experience with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection (preferred).
- Experience supporting frontier AI labs, technical enterprise customers, or research teams (preferred).
- Early-stage startup experience and ability to work independently (preferred).
Benefits
- Competitive compensation
- 100% covered top-of-the-line medical, dental, and vision (US and Singapore)
- Lunch and dinner for in-office employees
- Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays
- Equinox membership (US)
- 401k (US)
- Commuter benefits (US)
- Health/wellness stipend (Singapore)
- Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
- Annual travel budget to visit either office