Agent Experience Engineer
$110k - $175k • Remote • San Francisco • FullTime
Posted 2mo ago
About the job
AgentMail is building the identity layer for AI agents, starting with email. Our most important user is an agent, which discovers and integrates with our product independently. We are seeking an Agent Experience Engineer to lead how AI models and agents discover and utilize AgentMail. This involves managing Answer Engine Optimization (AEO), evaluations, benchmarks, agent traces, documentation, and the `llms.txt` file. The company has secured $6M in funding from notable investors.
Responsibilities
- Ensure AgentMail is recommended when LLMs are queried about email or agent identity, measuring and improving share of voice on relevant prompts.
- Conduct original research through evaluations and benchmarks to assess how frontier, open-source, and agent harness models interact with AgentMail.
- Analyze agent traces to understand their reasoning and identify/resolve points of confusion on our documentation and site.
- Develop and refine the agent-facing surface, including `llms.txt`, MCP descriptions, documentation structure, and error messages.
- Manage the AEO content engine, guiding and verifying the automated page pipeline, briefing freelancers, and conducting backlink outreach.
- Oversee the weekly AEO briefing's action queue, addressing freshness debt and competitor monitoring.
Requirements
- Daily experience building with agents and strong opinions on agent product usability.
- A default approach of cross-functional collaboration.
- Willingness to express opinions early and publish honest, even inconvenient, writeups.
- A drive to deeply investigate complex technical problems, preferring trace analysis over guesswork.
- Understanding of retrieval mechanisms, specifically how models process chunks rather than full pages.
- Published technical writing or cited benchmarks are strongly preferred.
- Experience with SEO or AEO is beneficial.
- Contributions to documentation or MCP servers in the wild are a plus.
Benefits
- Compensation: $110K to $175K annually
- Equity: 0.2% to 0.5%