Research Engineer, Visual Knowledge Work
$350k - $850k • New York City, NY; San Francisco, CA; Seattle, WA
Posted 1mo ago
Job Location
New York City, NY; San Francisco, CA; Seattle, WA
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society. The Vision team is seeking a research engineer to focus on visual and spatial reasoning as core capabilities for LLMs. This role involves owning the end-to-end process of creating training data and RL environments for visual knowledge work. You will identify tasks, build evaluations, design rewards, and scale data, combining applied research with hands-on data work. Collaboration with external vendors, pretraining, RL, and product teams is essential to ensure the environments built translate into real-world knowledge work capabilities.
Responsibilities
- Own the data strategy for vision capabilities end-to-end, including building evals and scaling RL environments.
- Manage technical relationships with external data vendors, including writing task specifications, evaluating visual data and annotation quality, and iterating on reward design.
- Develop and improve QA frameworks to detect reward hacking and ensure environment quality at scale.
- Run generalization experiments to measure the impact of data strategy changes on multimodal capabilities.
- Partner with pretraining, RL, and product teams to align efforts and demonstrate progress.
Requirements
- 7+ years of ML, computer vision, and software engineering experience.
- Experience with reinforcement learning, reward design, or training data curation for large language or vision-language models.
- Familiarity with the architecture, training, and operation of large vision language models.
- Comfort managing technical vendor relationships and iterating quickly on feedback.
- Results-oriented with a bias towards flexibility and impact.
- Interest in the societal impacts of AI work.
Benefits
- Annual compensation range: $350,000 - $850,000 USD
- Visa sponsorship available
- Encouragement to apply even if not all qualifications are met
- Commitment to diversity and inclusion