Applied AI Engineer, Video Agent
$180k - $240k • San Francisco, Palo Alto, Los Angeles, Toronto
Posted 11h ago
Job Location
San Francisco, Palo Alto, Los Angeles, Toronto
Tech Stack
Remote Work Policy
On-site
Categories
AI Agent Engineer
About the job
HeyGen is seeking an Applied AI Engineer to join the Video Agent team. This role focuses on enhancing the capabilities of an AI agent that transforms prompts, documents, or assets into finished videos. You will be responsible for improving the agent's ability to understand user requests, redesigning tools it utilizes, building evaluation frameworks, and shipping new features across the full stack. This position offers a unique opportunity to work directly with in-house trained models and researchers, owning features from conception to launch and making critical decisions about where to apply AI versus deterministic code.
Responsibilities
- Design and build the AI agent, including its tools, prompts, and context.
- Improve the agent's planning, error recovery, and long-conversation handling.
- Develop evaluation metrics and offline replays to measure agent quality.
- Run experiments and analyze results to drive improvements.
- Observe user sessions and agent traces to identify issues.
- Build user-facing features using TypeScript and React.
- Develop backend services and workflows using Python and Go.
- Collaborate with product managers, designers, and research/rendering teams.
Requirements
- Experience building and shipping an AI agent that uses models to call tools, plan steps, and act on results.
- Proven ability to evaluate AI system performance and distinguish real improvements from noise.
- 2+ years of professional full-stack engineering experience.
- Fluency in TypeScript and React for frontend development.
- Fluency in Python for backend development.
- Strong product sense and user empathy.
- Demonstrated ownership and initiative in problem-solving.
Benefits
- Equity in a high-growth AI company
- 401K Match
- Health, dental, and vision benefits
- Flexible PTO
- Opportunity to help define a new category in AI video
- High ownership, high velocity, and direct impact on revenue growth