Software Engineer, Model Capabilities
$255k - $300k • San Francisco, California • FullTime
Posted 24d ago
Job Location
San Francisco, California
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
LLM Engineer
About the job
The Model Capabilities team at Notion is responsible for maintaining Notion AI's model layer, ensuring it remains at the cutting edge. This involves integrating new frontier models as they become available, guaranteeing reliable and cost-effective inference at scale, and developing new AI capabilities that can be leveraged by other teams within Notion. The role is based in either San Francisco or New York City, with a hybrid work arrangement requiring in-office presence on Mondays, Tuesdays, and Thursdays.
Responsibilities
- Integrate new frontier models into production rapidly for user and engineer access.
- Enhance inference reliability through improved error categorization, self-healing retries, and cross-provider failover.
- Manage observability for the model layer to reduce detection and resolution times.
- Develop new model-level capabilities and facilitate their adoption by product teams.
- Act as a liaison across Notion's AI teams to identify gaps, remove blockers, and ensure proper ownership of fixes.
Requirements
- Stay current with the rapidly evolving model landscape, forming informed opinions on new developments and pragmatically assessing adoption opportunities.
- Demonstrate practical AI fluency by actively using AI tools in your own work and understanding their strengths and limitations.
- Possess experience building and operating production AI systems on top of LLM APIs, understanding concepts like token economics, streaming, tool calling, and context limits, including their failure modes.
- Prioritize measurement and data-driven decision-making for prompt or model changes, defining success metrics and using evaluations to test hypotheses.
- Exhibit cost and performance awareness, treating latency and cost as product qualities and understanding the trade-offs with output quality.
Benefits
- Highly competitive cash compensation
- Equity
- Health insurance
- Paid time off