Staff Software Engineer, AI Reliability
San Francisco, CA | New York City, NY | Seattle, WA
Posted 16d ago
Job Location
San Francisco, CA | New York City, NY | Seattle, WA
Tech Stack
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
Anthropic's mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society. The AI Reliability Engineering (AIRE) team partners with other teams across Anthropic to enhance the reliability of critical serving paths, from SDKs through API layers, serving infrastructure, and accelerators. This role offers a unique, cross-cutting exposure to the most important systems at Anthropic, requiring a holistic view of system composition and reliability.
Responsibilities
- Develop Service Level Objectives for large language model serving systems, balancing availability, latency, and development velocity.
- Design and implement monitoring and observability systems for the token path.
- Assist in designing and implementing high-availability serving infrastructure across multiple regions and cloud providers.
- Lead incident response for critical AI services, ensuring rapid recovery, thorough reviews, and systematic improvements.
- Support the reliability of safeguard model serving, crucial for site reliability and Anthropic's safety commitments.
Requirements
- Strong distributed systems, infrastructure, or reliability backgrounds.
- Reliability-minded software engineering or SRE experience.
- Curiosity and bravery to address unfamiliar systems during incidents.
- Holistic thinking about system composition and seams.
- Ability to build lasting relationships across teams.
- Ownership over outcomes, even for systems not directly managed.
- Excellent communication and collaboration skills.
- Diverse experience in areas like product stacks, database scaling, or large distributed systems.
- Bachelor's degree or equivalent combination of education, training, and experience.
Benefits
- Annual compensation range: $325,000 - $485,000 USD
- Visa sponsorship available for some roles.