Senior Software Engineer, Backend (Product)

$185k - $230k • Remote • Mountain View, CA

Posted 1mo ago

Job Location

Mountain View, CA

Tech Stack

Remote Work Policy

Fully remote

Categories

AI Engineer

About the job

We are building the next generation of AI-native product experiences where conversations directly translate into outcomes. As a Senior Software Engineer on our Product teams, you will own significant product areas and play a key role in shaping how AI capabilities deliver real user value. You will work across the full lifecycle of AI-driven features, from data ingestion and model orchestration to output structuring and delivery into user-facing product surfaces. This role involves not only building features but also designing the underlying systems, ensuring AI outputs are reliable, performant, and aligned with user needs. You will tackle complex, ambiguous problems, driving them from concept to production while making thoughtful tradeoffs across latency, cost, and quality. This includes defining how LLMs, retrieval systems, and structured data converge to create cohesive product experiences. Collaborating closely with product, design, and AI teams, you will rapidly prototype and iterate on features like summaries and intelligent workflows, while helping establish best practices for other engineers.

Responsibilities

  • Own end-to-end delivery of AI product features, leading design and implementation from concept to production.
  • Drive system design for AI-backed experiences, orchestrating LLMs, retrieval, and structured data with tradeoffs for flexibility, reliability, and performance.
  • Elevate product quality through iteration and evaluation, establishing and improving feedback loops.
  • Lead technical direction within a product area, breaking down ambiguous problems and guiding execution.
  • Mentor engineers on code quality, system design, and product thinking.
  • Accelerate team velocity through effective use of AI-assisted development tools.

Requirements

  • 5+ years of experience building and scaling product-facing systems.
  • Proven track record of owning complex features or product areas end-to-end.
  • Proficiency in writing clean, maintainable code (Python preferred) and making strong architecture/design decisions.
  • High bar for product quality, focusing on user value.
  • Experience working with AI/LLM-powered systems or ability to quickly contribute.
  • Ability to drive projects from idea to production with strong ownership.
  • Experience mentoring others and providing technical leadership.
  • Ability to thrive in ambiguous, fast-moving environments and set technical direction.

About Otter.ai

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.