Software Engineer, Human Data Interface
San Francisco, CA | New York City, NY
Posted 16d ago
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
Anthropic's Human Data Interfaces team is responsible for building the systems that collect data to improve AI models. This includes developing novel interfaces for data vendors, creating essential tooling, and establishing the front-end and back-end infrastructure that empowers researchers to gather high-quality data at scale. As a Software Engineer on this team, you will take ownership of the architecture and execution of our data collection pipelines. Your role will involve designing systems that are not only performant at scale but also resilient to the dynamic needs of our research teams. You will collaborate closely with researchers, our cross-functional data operations partners, and the crowdworkers and vendors who utilize these tools daily.
Responsibilities
- Architect and build data collection pipelines that support rapid iteration, balancing data quality and system maintainability.
- Design clear and efficient interfaces for crowdworkers and vendors to ensure high-quality data collection.
- Collaborate with research teams to understand evolving data needs and iterate quickly on collection methods.
- Partner with the Human Data Operations team to optimize end-to-end data workflows and improve interface usability.
- Prioritize and manage multiple workstreams, making trade-off decisions in a fast-paced environment with shifting research priorities.
Requirements
- Strong full-stack engineering experience across the entire technology stack.
- Proficiency in building internal tools and understanding user needs.
- Ability to thrive in fast-moving environments, balancing iteration speed with long-term system health.
- Capacity to quickly learn and understand complex technical systems.
- Experience building human data labeling interfaces, human-in-the-loop systems, or data collection pipelines.
- Familiarity with preference data and reward models in AI model training.
- Experience working with researchers as internal users.
- Background in building and improving user-facing applications, especially those with complex UI interactions or annotation workflows.
- Strong system design instincts for building gracefully evolving systems.
- Experience influencing technical and product direction within a team.
Benefits
- Annual compensation range: $320,000 - $405,000 USD
- Visa sponsorship available