Senior Software Engineer, AI Developer Experience
$195k - $229k • Remote • Remote U.S. • FullTime
Posted 11h ago
Job Location
Remote U.S.
Tech Stack
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Agent Engineer
About the job
Vanta is seeking a Senior Software Engineer for its AI Developer Experience team. This role will focus on building the systems, infrastructure, and developer workflows that enhance the usefulness, reliability, and ease of adoption of AI-powered engineering for Vanta engineers. The AI DX team is developing foundational elements for a more autonomous software development experience, including background agents, agent evaluation systems, and tools to improve engineer-AI collaboration. The position involves working directly with engineers to identify workflow challenges, build practical solutions, and use usage data to continuously improve quality and reliability.
Responsibilities
- Plan, build, and improve background-agent infrastructure for reliable, trackable, and repeatable automated engineering work.
- Develop systems for evaluating agent performance based on task outcomes, quality, human intervention, cost, and other signals.
- Create evaluation sets and feedback loops to facilitate AI system improvement through regular review and tuning.
- Enhance how engineers discover, understand, and utilize shared AI tools and workflows.
- Evaluate AI development tools (e.g., code generation, AI-assisted review, testing) against engineering needs and integrate useful ones.
- Develop visibility into the usefulness of tools and workflows, identify friction points, and guide their evolution.
- Create clear guidance and documentation to help engineers adopt new AI-enabled development practices.
- Improve code review workflows by using feedback from engineering work to address recurring friction.
- Influence the foundations of an autonomous software factory, including systems for safe and effective bounded engineering tasks by agents.
- Collaborate directly with engineers and internal users to understand needs, validate solutions, and make product tradeoffs.
- Manage ambiguous, dependency-heavy projects from exploration to reliable delivery.
- Raise the quality bar through code reviews, technical design discussions, testing, observability, and attention to reliability and security.
- Partner with engineers and cross-functional stakeholders as a dependable, collaborative teammate.
- Utilize AI in daily work to amplify skills and strengthen outcomes, applying it across workflows and actively building fluency.
Requirements
- Substantial industry software engineering experience.
- Experience in technical leadership roles on teams or complex projects.
- Experience improving AI systems, creating evaluation sets, and driving quality improvements through measurement and iteration.
- Strong software engineering fundamentals and experience designing, building, testing, and operating reliable systems.
- Experience with developer tooling, AI-enabled workflows, agentic systems, infrastructure, or related technical domains.
- Proven ability to work through ambiguity, decompose complex problems, manage dependencies, and complete projects.
- Experience in rapidly scaling startups or larger companies with a strong bias for action.
- Action-oriented approach with a willingness to engage directly with users and contribute hands-on.
- Product judgment and curiosity, with strong technical opinions focused on user-centric platforms.
- Strong written and verbal communication skills, with the ability to explain technical concepts clearly and create adoption guidance.
- Collaborative approach and demonstrated ability to make meaningful team contributions.
- Proficiency in using AI in day-to-day work to amplify skills and strengthen outcomes.
Benefits
- Industry-competitive salary and equity
- Comprehensive medical, dental, and vision coverage
- 100% of employee-only benefit premiums covered for most medical plans
- 16 weeks paid Parental Leave
- Health & wellness stipend
- Remote workspace, internet, and cellphone stipend
- Commuter benefits for SF and NYC office team members
- Family planning benefits
- Matching 401(k) contribution with immediate vesting
- Flexible PTO policy
- 80 hours of Sick Time
- 11 company-paid holidays
- Virtual team building activities, lunch and learns, and company-wide events
