Software Engineer, Tokens and Prompt Structures
$320k - $405k • San Francisco, CA | New York City, NY
Posted 1mo ago
Job Location
San Francisco, CA | New York City, NY
Tech Stack
Remote Work Policy
On-site
Categories
LLM Engineer
About the job
The Encodings Infra team at Anthropic maintains the libraries that engineers and researchers use to encode text and multimodal data for Claude. This team also defines Claude's prompt structure, including how user turns are represented and how Claude interacts with tools. As a Software Engineer on this team, you will be responsible for the design and upkeep of these libraries, ensuring their APIs are intuitive, performance is optimized, and abstractions are robust. Your work will span across various systems, from pretraining to finetuning and the API, requiring close collaboration with researchers and engineers to facilitate the rapid transition of new encoding ideas from experimentation to production.
Responsibilities
- Maintain and improve encoding libraries for internal engineers and researchers.
- Conduct experiments to determine optimal structured data feeding methods for Claude.
- Design data structures and abstractions to simplify encoding details for most users while supporting advanced users.
- Adapt encoding libraries to support new research directions and production deployment.
- Optimize encoding performance across dependent systems.
Requirements
- 5+ years of software engineering experience, including significant time maintaining libraries, SDKs, or developer-facing APIs.
- Familiarity with ML terminology and LLM architecture to effectively collaborate with researchers.
- Experience performing complex refactors in large codebases.
- Strong communication skills and ability to collaborate closely with researchers and engineers.
- Results-oriented with a bias towards flexibility and impact.
- Willingness to take on tasks outside of the immediate job description.
- Interest in the societal impacts of AI work.
Benefits
- Annual Salary: $320,000 - $405,000 USD
- Visa sponsorship available for some roles.
- Encouragement to apply even if not all qualifications are met.