Engineering Manager (AI)
$185k - $230k • Remote • San Jose, CA • FullTime
Posted 5h ago
Job Location
San Jose, CA
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
AiPrise is seeking an Engineering Manager to lead and grow the team responsible for building the company's AI agents. This is a player-coach role where you will manage, hire, and develop engineers, while also staying hands-on with agent architecture design, prompt reviews, tool definitions, and debugging evaluations. You will be responsible for the end-to-end process of building, measuring, and shipping AI agents, including the skills and tools they utilize, their memory capabilities, and the evaluation metrics that ensure quality and performance in a regulated domain like KYC and KYB. The role emphasizes the importance of quality and observability alongside speed, as inaccurate AI decisions can have significant financial and audit implications for customers.
Responsibilities
- Manage a team of 5-6 AI and backend engineers, providing 1:1s, setting goals, giving feedback, and supporting career growth.
- Lead the hiring process for AI engineers, raising the bar for agent engineering roles.
- Collaborate with product management on AI roadmap planning and delivery to ensure predictable cycles and prevent burnout.
- Foster a culture of writing evaluations before claiming success and learning from incidents without blame.
- Design and review compliance agents for tasks ranging from single document checks to multi-step investigations.
- Build reusable skills, tools, and memory mechanisms for agents to interact with data vendors and maintain context.
- Own the evaluation stack, including golden datasets, regression tests, and production monitoring.
- Write and review code approximately 50% of the time, selecting models based on accuracy, cost, and latency.
Requirements
- 2+ years of direct management experience, including hiring, performance reviews, and handling difficult conversations.
- Proven track record of developing engineers, leading to promotions or expanded responsibilities.
- Experience managing team planning and delivery in a fast-paced startup or scale-up environment.
- 6+ years of software engineering experience with strong backend skills in Python or TypeScript.
- Experience building and shipping LLM agents to production, with the ability to troubleshoot issues.
- Practical experience designing tool and function-calling interfaces.
- Experience packaging reusable skills or prompt modules.
- Experience implementing agent memory solutions (short-term context, long-term stores, retrieval).
- Experience building evaluations to gate releases.
- Comfort with at least one major model API (Anthropic, OpenAI, or similar).
- Understanding of trade-offs between agent frameworks and custom code.
- A habit of measuring and using evaluations to drive decisions.
- Clear written communication skills, capable of explaining technical issues to both technical and non-technical stakeholders.
- Good judgment on build vs. buy decisions and when to incorporate human oversight.