Senior / Staff Machine Learning Research Scientist, Agents
$302k - $378k • San Francisco, CA; Seattle, WA; New York, NY
Posted 2mo ago
Job Location
San Francisco, CA; Seattle, WA; New York, NY
Tech Stack
Remote Work Policy
On-site
Categories
AI Research Engineer
About the job
This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data, interaction, and evaluation. You will contribute to impactful research publications on agents, collaborate with customer researchers, and work alongside the engineering team to translate these advancements into real-world, scalable solutions.
Responsibilities
- Research on agent environments and RL reward signals.
- Benchmark autonomous agent performance across real-world scenarios and environments.
- Create robust data programs to improve LLM agentic capabilities.
- Build foundational tools and frameworks for evaluating models as agents.
- Contribute to impactful research publications on agents.
- Collaborate with customer researchers.
- Translate research advancements into real-world, scalable solutions.
Requirements
- Practical experience working with LLMs.
- Proficiency in frameworks like Pytorch, Jax, or Tensorflow.
- Adept at interpreting research literature and quickly turning new ideas into prototypes.
- Track record of published research in top ML venues (e.g., ACL, EMNLP, NAACL, NeurIPS, ICML, ICLR, COLM).
- At least three years of experience addressing sophisticated ML problems, either in a research setting or product development.
- Strong written and verbal communication skills.
- Ability to operate cross-functionally.
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend