New: upload your resume and get matched to AI jobs. Free to start →

Staff Software Engineer, AI Developer Experience

CA - San Francisco; WA - Seattle • Full-time

Posted 21d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Engineer

About the job

SoFi's AI Platform team is building the foundation that empowers all engineers to develop faster, safer, and with greater leverage from AI. The AI Developer Experience (AI DevEx) team specifically focuses on SoFi's interactive coding strategy and its underlying infrastructure, including AI economics, coding harnesses, evaluation platforms, the enterprise AI Gateway, and intelligent model routing. As a founding Staff Software Engineer on this team, you will be a technical leader responsible for major platform systems, setting engineering standards, and collaborating closely with other engineering teams.

Responsibilities

  • Own and operate foundational components of the AI Gateway, model routing, eval platform, and harness vending, transforming broad challenges into production-grade systems.
  • Develop usage telemetry, cost allocation, and chargeback mechanisms to provide transparent visibility into AI spend per developer.
  • Lead team execution by planning feature architecture, implementation paths, and aligning cross-team dependencies.
  • Facilitate design reviews, evaluate architectural trade-offs, and align technical outcomes with the broader engineering community.
  • Define coding conventions, automated patterns, and architectural standards for maintainable and extensible software.
  • Automate build, test, and deployment workflows, resolve production incidents, and address root causes.
  • Maintain a 6-to-12-month technical vision, anticipating system growth and prioritizing architectural hygiene.
  • Partner with internal engineering teams to understand workflows, drive adoption of interactive coding tools, and enhance systems based on feedback.
  • Mentor and develop engineers by providing constructive code and design feedback.

Requirements

  • Bachelor's Degree + 3-4 years of experience or Master's Degree + 2-3 years of experience in software engineering, computer science, or a related field.
  • Advanced programming expertise in at least one modern backend language (e.g., Java, Kotlin, Python, Go, Scala).
  • Proven distributed systems expertise with sound judgment on trade-offs across security, concurrency, fault tolerance, horizontal scaling, and idempotence.
  • Track record of technical leadership in feature delivery, cross-functional alignment, and architecture on production platforms.
  • Hands-on experience developing or building AI-assisted developer tooling and LLM-based systems (e.g., coding assistants, autonomous agents, prompt engineering, tool execution frameworks).
  • Hands-on experience with cloud infrastructure (AWS/GCP), containerization, modern CI/CD pipelines, and operational on-call service ownership.
  • Product-oriented engineering mindset, treating internal developers as customers and measuring success through platform adoption and user sentiment.
  • Clear written and verbal communication skills, including drafting technical design documents and presenting options to diverse stakeholders.
  • Responsibly apply AI tools to prototype solutions, navigate codebases, and accelerate implementation while upholding security and safety standards.
  • Critically inspect and validate AI-generated code, backing all implementations with comprehensive automated tests.
  • Maintain rigorous compliance with data governance and security policies.
  • Elevate team productivity by establishing and sharing proven harnesses, prompt templates, and operational guardrails.

Benefits

  • Comprehensive and competitive benefits package