Staff Software Engineer, Agents
$231k - $340k • Remote • New York • FullTime
Posted 3mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to build a generational company at an inflection point, with strong product-market fit and investor support, scaling rapidly to define a new category. The team operates with intensity, ownership, and a commitment to the mission, valuing decisiveness, simplicity, and continuous improvement. As a Software Engineer, Agents, you will be instrumental in building the systems that make AI agents indispensable to legal professionals, designing environments, managing context windows, creating tools, and developing evaluations to unlock new capabilities.
Responsibilities
- Design environments and actions for agentic professional work.
- Make model selection decisions.
- Manage context windows.
- Create optimal tools.
- Develop evaluations to enable faster iteration loops and unlock new capabilities.
- Partner with customers and PMs to understand legal workflows and design practical evaluations.
- Ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and apply learnings to products.
Requirements
- Passion for building effective domain-specific agents.
- Iterative mindset with experience developing proof of concepts, making quick decisions, and shipping v0s.
- Comfortable using evaluations to drive quality.
- Humble and adaptable about code and frameworks, driving adoption of new best practices.
- 8+ years of software engineering experience (post-BS/MS).
- Proficiency in Python.
- Experience working with LLM APIs and agent frameworks.
- Experience shipping user-facing products (backend or full-stack).