Senior Software Engineer, AI Platform
$220k - $300k • Remote • San Francisco • FullTime
Posted 4mo ago
Job Location
San Francisco
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform and deep domain expertise. We are building a generational company at an inflection point, with strong product-market fit and investor support, scaling fast and defining a new category. The AI Platform team builds the foundational model layer and agent infrastructure that determines the quality of work our agents deliver. This role is crucial for setting the ceiling for what Harvey's AI can achieve, especially in challenging domains like legal where accuracy is paramount.
Responsibilities
- Design and build platform-level systems and abstractions to enhance agentic products.
- Own infrastructure for model integration, routing, and evaluation to optimize foundation model deployment.
- Develop evaluation frameworks and tooling for teams to iterate on AI quality.
- Partner with product engineering, PMs, and design to launch AI products.
- Evaluate, prototype, and integrate advancements in AI and agentic systems.
Requirements
- 5+ years of backend systems experience, with at least 1 year in AI/ML engineering (8+ years for staff level with technical leadership).
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems in AI or distributed systems.
- Proven track record of building adopted internal platforms, SDKs, or shared infrastructure.
- Strong judgment regarding abstractions and a pragmatic approach to incremental shipping.
- Excitement about agentic AI and the infrastructure challenges of reliable autonomous systems.
- Bias toward full ownership and navigating ambiguity.
- Bonus: experience with evaluation frameworks, agent/function-calling architectures, legal domains, or early-stage/hyper-growth startups.