Engineering Manager, AI Platform
$272k - $355k • Remote • San Francisco • FullTime
Posted 3h ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Engineer
About the job
Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform. As we scale rapidly and take on increasingly complex use cases, we are expanding our engineering team to accelerate our ability to ship fast, delight users, and build infrastructure that scales with us. As an Engineering Manager for AI Platform, you will lead and scale a team of engineers building the foundational systems that power AI across Harvey. This includes model access and routing, agent and workflow orchestration, evaluation frameworks, tool and context infrastructure, and the observability needed to run LLM-powered products reliably at scale. You will partner with Product, Research, and product engineering teams to turn fast-moving advances in applied AI into durable, reusable platform capabilities and set the technical direction for how teams across Harvey build, test, and ship AI features. This role requires both technical depth and product intuition, with a focus on making fast, high-quality decisions, working at the cutting edge of applied AI, and growing a team that embodies engineering excellence.
Responsibilities
- Lead and grow a team of engineers building the core AI platform that powers Harvey’s products.
- Define the roadmap for shared AI infrastructure, including model gateways and routing, agent orchestration, tool calling, prompt and context management, and long-running job execution.
- Partner with Product, Research, and product engineering teams to understand their needs and turn recurring patterns into reusable, well-documented platform primitives.
- Build and scale evaluation, testing, and monitoring systems for AI features.
- Drive reliability, latency, cost efficiency, and security across LLM-powered systems.
- Evaluate and adopt new models, frameworks, and techniques.
- Contribute to code and architecture reviews, unblock teams, and lead by example.
- Hire, grow, and retain exceptional engineers.
Requirements
- 2+ years of experience in a software engineering management role leading platform, infrastructure, or full stack product engineering teams.
- 5+ years of experience as a backend, infrastructure, or full stack engineer.
- A track record of leading high-performing, engaged engineering teams.
- Experience building and operating production systems powered by LLMs (e.g., agents, retrieval, tool use, or evaluation pipelines).
- Experience building internal platforms or shared services and partnering with cross-functional stakeholders.
- Strong backend engineering skills in modern languages and frameworks (e.g., Python, Go, Node).
- Familiarity with distributed systems concepts.
- Sound judgment on tradeoffs among quality, latency, cost, and speed of delivery in AI systems.