Research Fellow
$85k - $165k • New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
Posted 8d ago
Job Location
New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Snorkel AI is seeking a Research Fellow to build open benchmarks and evaluation environments that help shape how AI progress is measured. This fellowship is designed for PhD students and postdocs who wish to translate significant research questions into novel AI evaluation methods. The fellow will lead projects from inception to public release, with guidance from a Snorkel researcher and access to company resources, including domain experts and compute power. This role involves a hybrid work arrangement, with at least one day per week spent with Snorkel's research team in San Francisco or New York offices.
Responsibilities
- Scope and lead the development of a new benchmark, dataset, or evaluation environment in an area with current evaluation shortcomings.
- Define task specifications, rubrics, and reference answers in collaboration with domain experts.
- Manage the expert review process for created artifacts.
- Publicly release research artifacts with the fellow as lead author.
- Participate in weekly research meetings to share progress, provide feedback, and contribute to other researchers' projects.
Requirements
- Demonstrated ability to translate research ideas into functional code, datasets, tools, or other usable research artifacts.
- Proficiency in working with domain experts outside of one's own field to incorporate their judgment into specifications.
- Ability to scope and manage a project to a public release within the fellowship term.
- Research background suitable for designing and building open benchmarks, datasets, or environments.
- Enthusiasm for advancing AI evaluation methodologies within one's field.
Benefits
- Snorkel research co-advisor matched to the project.
- Access to domain experts, compute resources, and engineering support.
- Opportunity to release an open-source academic artifact.
- Inclusion in research team meetings and events with other fellows.
- Research communications support for sharing findings.
- Exposure to the operations of a leading data research lab bridging academic research and industry applications.