Staff Software Engineer, AI Platform
$231k - $340k • Remote • San Francisco • FullTime
Posted 3mo ago
Job Location
San Francisco
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Harvey is transforming legal and professional services by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise. We are building a generational company at an inflection point, scaling fast and defining a new category. The AI Platform team builds the foundational model layer and agent infrastructure that determines the quality of work our agents deliver. This team is early and has significant opportunities to shape the future of AI at Harvey, impacting everything from model routing and agent architecture to context management and evaluation.
Responsibilities
- Design and build platform-level systems and abstractions to enhance agentic products.
- Own infrastructure for integrating, routing, and evaluating foundation models.
- Develop evaluation frameworks and tooling for teams to improve AI quality.
- Collaborate with product engineering, PMs, and design to launch AI products.
- Evaluate, prototype, and integrate new advancements in AI and agentic systems.
Requirements
- 8+ years of backend systems experience, with 1+ year in AI/ML engineering.
- Proven track record of technical leadership across teams.
- Experience building and deploying multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems in AI or distributed systems.
- Experience building adopted internal platforms, SDKs, or shared infrastructure.
- Strong judgment regarding abstractions and pragmatic, incremental shipping.
- Excitement for agentic AI and the challenges of reliable autonomous systems.
- Ability to navigate ambiguity and take ownership without a predefined roadmap.
- Bonus: experience with evaluation frameworks, agent/function-calling architectures, legal domains, or early-stage startups.