Senior Software Engineer, Agents

$193k - $290k Remote New York FullTime

Posted 3mo ago

Job Location

New York

Tech Stack

Remote Work Policy

Fully remote

Employment Type

FullTime

Categories

AI Agent Engineer

About the job

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to build a generational company at an inflection point, scaling rapidly and defining a new category. The team operates with intensity, ownership, and a commitment to the mission, valuing decisiveness, simplicity, and continuous improvement. If you are driven to do the best work of your career alongside like-minded individuals, Harvey is the place to be.

Responsibilities

  • Design environments and actions for agentic professional work.
  • Make model selection decisions and manage context windows.
  • Create optimal tools and develop evaluations for faster iteration loops.
  • Partner with customers and PMs to understand legal workflows and ship agents.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  • Improve observability and instrumentation to profile agent behavior and identify bottlenecks.
  • Stay current on new developments in agentic systems and apply learnings to products.

Requirements

  • Passion for building effective domain-specific agents.
  • Iterative mindset with experience developing proof of concepts and shipping v0s.
  • Comfortable using evaluations to drive quality.
  • Humble and adaptable regarding code and frameworks, driving adoption of best practices.
  • 5-8 years of software engineering experience (post-BS/MS).
  • Proficiency in Python.
  • Experience working with LLM APIs and agent frameworks.
  • Experience shipping user-facing products (backend or full-stack).

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.