Senior Software Engineer, Agents (Foundation Agents)
$225k - $250k • San Francisco, CA • FullTime
Posted 1mo ago
Job Location
San Francisco, CA
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Fieldguide is building software to automate and streamline the work of assurance and audit practitioners in cybersecurity, privacy, and financial audits. The Foundation Agents team focuses on the long-horizon agents that power the Fieldguide AI platform, working at the forefront of AI product development in areas like agent knowledge, evaluations, and improving quality and reliability at scale. As a Senior Software Engineer on this team, you will take ownership of how agent quality is measured and improved, and contribute to driving the platform forward.
Responsibilities
- Develop and implement the strategy for evaluations and error analysis to measure and improve agent quality.
- Design and build infrastructure for agent knowledge and evaluation for long-horizon agents.
- Lead error analysis of agent behavior and translate findings into platform-level reliability improvements.
- Build and harden backend systems for agent execution, evaluation, and monitoring at scale.
- Drive the AI platform's reliability and quality roadmap in collaboration with the AI team.
- Mentor engineers on rigorous evaluation and error-analysis practices.
Requirements
- 1+ years of experience working specifically on agents.
- Strong experience working on an AI platform.
- Demonstrated experience building evaluations and performing error analysis.
- Backend engineering experience.
- Strong platform engineering skills (nice-to-have).
- Frontend experience (nice-to-have).
- Distributed systems experience (nice-to-have).
Benefits
- Competitive compensation with equity
- Comprehensive health and wellness benefits
- Flexible time off and work schedules
- Technology reimbursements
- 401(k) plan
- Twice-yearly in-person offsites across the U.S.
- Wellness benefits starting on your first day