Senior Software Engineer, Agents
$193k - $290k • Remote • New York • FullTime
Posted 8d ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This is an opportunity to join a fast-scaling company at an inflection point, defining a new category in real-time. The team operates with intensity, ownership, and a commitment to continuous improvement, driven by values of decisiveness, simplicity, and a 'job's not finished' mentality. We are looking for individuals who want to do the best work of their careers alongside driven colleagues.
Responsibilities
- Design environments and actions for agentic professional work, including model selection, context window management, tool creation, and developing evaluation frameworks.
- Partner with customers and PMs to understand legal workflows, define evaluation metrics for excellence, and ship agents that effectively complete tasks.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Collaborate with the model infrastructure team to design and implement low-latency agent execution infrastructure, including caching, parallel tool calls, and subagent patterns.
- Enhance observability and instrumentation to profile agent behavior, identify bottlenecks, and guide optimization efforts.
- Stay updated on new developments in agentic systems and integrate these learnings into product development.
Requirements
- Passion for building effective domain-specific agents.
- Iterative mindset with experience in developing proof of concepts, making quick decisions, and shipping initial versions.
- Comfortable using evaluations to drive quality.
- Adaptable and humble regarding code and frameworks, with a willingness to drive adoption of new best practices.
- 5-8 years of software engineering experience (post-BS/MS).
- Proficiency in Python and experience working with LLM APIs and agent frameworks.
- Experience shipping user-facing products, either backend or full-stack.