Senior Research Infrastructure Engineer
$175k - $260k • Remote • San Francisco • FullTime
Posted 5h ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Research Engineer
About the job
HUD is building reliable, fair, and open infrastructure for AI data, aiming to make data valuable for creators and trustworthy for AI training labs. As a Senior Research Infrastructure Engineer, you will accelerate research on training and evaluating frontier AI agents by building the software and infrastructure that enables researchers to iterate on environments, collect trajectories, and evaluate model behavior. You will collaborate closely with research engineers to understand their needs, identify bottlenecks, and transform research code into robust, reusable systems, owning the tools, pipelines, and execution infrastructure that support their exploration and scaling of promising approaches.
Responsibilities
- Build infrastructure for agent behavior research, including environment execution, trajectory collection, and large-scale evaluation.
- Develop reusable tools, APIs, and pipelines for experiment launching, dataset management, and result inspection.
- Convert research prototypes into tested, documented, and reusable software.
- Design experiments to analyze model behavior, agent failure modes, and data quality.
- Enhance experimentation speed, reproducibility, and cost-efficiency through improved orchestration, observability, and failure recovery.
- Partner with research and engineering teams to align infrastructure priorities with evolving research needs, managing systems from implementation to operation.
Requirements
- Strong software engineering fundamentals and Python proficiency, with a history of building maintainable systems.
- Experience owning backend services, data pipelines, developer tools, or infrastructure from design to operation.
- Sound judgment regarding APIs, data models, asynchronous workloads, and building reliable systems.
- Comfort with Docker, Linux, cloud infrastructure, and debugging complex system failures.
- Ability to collaborate with researchers, understand experimental workflows, and translate research needs into software solutions.
- Independent technical judgment for setting priorities and making pragmatic architecture decisions.
- Working knowledge of reinforcement learning concepts (environments, rollouts, reward signals, evaluation workflows) is a plus.
- Experience building research infrastructure, ML pipelines, or tools that enhance research team productivity is a plus.
- Familiarity with distributed job execution, containerized environments, or high-concurrency workloads is a plus.
- Track record of improving experiment reproducibility, data lineage, or pipeline visibility is a plus.
Benefits
- Competitive compensation
- 100% covered top-of-the-line medical, dental, and vision (US and Singapore)
- Lunch and dinner for in-office employees
- Company-wide holiday break (Christmas Eve to New Year’s Day)
- PTO and paid holidays
- 401k with a 4% match
- Equinox membership (US)
- Commuter benefits (US)
- Health/wellness stipend (Singapore)
- Unlimited access to tokens for ChatGPT, Claude Code, Cursor, etc.
- Annual travel budget to visit offices
- Support for relocation and visas for strong full-time candidates to the US or Singapore