Software Engineer, Agent
San Francisco • FullTime
Posted 1mo ago
Job Location
San Francisco
Tech Stack
Remote Work Policy
On-site
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Variance is building AI agents to handle complex judgment calls at scale in areas like risk investigation, fraud, and identity reviews. This role involves owning the technical delivery of these agents for enterprise clients, working directly with them from initial demos through production. You will build agents that make real decisions within fraud and risk workflows, directly impacting how businesses operate. This is a foundational hire with the opportunity to shape the future of AI agent development at the company, pushing the boundaries of what's possible with AI.
Responsibilities
- Design and ship production-grade AI agents for fraud and risk workflows, handling millions of investigations per deployment.
- Own the technical evaluation of AI agents, designing evaluations and PoCs based on customer data and driving pilot and production deployments.
- Translate customer edge cases into technical evaluations and act as the technical voice with executive stakeholders.
- Encode operational stakeholder judgment directly into AI agents.
- Manage the end-to-end agent development lifecycle, from scoping and engineering context/tools to building evals and tuning performance.
- Set the standard for well-built AI agents.
- Participate in the pre-sales process by running technical discovery and designing customized demos for clients.
- Shape the long-term product roadmap based on observed patterns across customer deployments.
- Build an onboarding verification agent for an enterprise marketplace.
- Design a supervisor layer to verify agent decisions.
- Engineer an eval harness for fraud detection against real-world data.
Requirements
- 3-5 years in customer-facing technical roles (forward-deployed, solutions engineering, or software engineering with customer exposure).
- Strong software engineering fundamentals with a proven track record of shipping end-to-end production systems.
- Hands-on experience building with LLMs, including prompt engineering, context engineering, tool use, and evaluations.
- Calibrated understanding of LLM capabilities and limitations.
- Strong problem-solving skills in ambiguous and fast-changing environments.
- Ability to translate fuzzy customer workflows into working systems.
- Comfort working directly with customers and communicating complex technical concepts to both engineers and executives.
- Familiarity with deploying agentic systems in production (bonus).
- Domain experience in fraud or risk (bonus).
- Experience shipping into regulated environments (security reviews, data residency, audits) (bonus).
Benefits
- Platinum-level medical, dental, and vision insurance
- Unlimited PTO, sick leave, and parental leave
- Up to $100/month reimbursement for personal health and wellness expenses
- Up to $200/month in commuter benefits
- Free lunch and dinner
- 401(k) plan with employer match (eligible after 6 months)
- Meaningful equity in a fast-growing, Series A company