[DH] Engineering Manager, AI Observability
$405k - $850k • San Francisco, CA
Posted 6h ago
Job Location
San Francisco, CA
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
As an Engineering Manager for the AI Observability team, you will lead research engineers in designing and building systems that enable AI to analyze vast, unstructured datasets, such as tens or hundreds of thousands of conversations or documents, to produce structured and trustworthy insights. This role operates across the full stack, encompassing core analysis frameworks to user-facing applications and interfaces. The tools you develop will be instrumental for dozens of researchers and investigators, directly influencing our capacity to measure and mitigate AI misuse and misalignment. This is a high-leverage position within a rapidly growing team.
Responsibilities
- Lead the design and implementation of AI-based monitoring systems for AI training and deployment.
- Extend and improve core frameworks for processing large volumes of unstructured text.
- Partner with researchers and safety teams to understand analytical needs and prioritize team work.
- Develop agentic integrations for autonomous investigation and action on analytical findings.
- Contribute to the team's strategic direction, including build, partner, and investment decisions.
- Coach and support direct reports in their professional growth.
- Manage team recruiting efforts to ensure adequate growth.
- Design processes to enhance team operational effectiveness.
Requirements
- At least 2 years of experience in people management, with a genuine enjoyment of the role.
- 5+ years of software engineering experience, including significant exposure to ML systems.
- Familiarity with LLM application development (context engineering, evaluation, orchestration).
- Experience building tools for others, with a focus on UX, reliability, and documentation.
- Ability to switch between deep infrastructure work and user-facing product thinking.
- Thrive in collaborative, cross-functional environments.
Benefits
- Annual compensation range: $405,000 - $850,000 USD
- Visa sponsorship available