New: upload your resume and get matched to AI jobs. Free to start →

Staff Engineer, AI

$250k - $350k • San Francisco • Full-time

Posted 11d ago

Remote Work Policy

On-site

Employment Type

Full-time

Visa Sponsorship

The posting says they sponsor visas

Categories

AI Engineer

About the job

LiteLLM is seeking a Staff Engineer to lead its unified API team. This is a hands-on technical leadership role focused on ensuring seamless integration of new AI models and providers into the LiteLLM platform from day one. You will be responsible for the architecture and implementation of provider-agnostic features, leading a team of engineers, and maintaining a high standard for code quality. The role involves triaging open-source issues, reviewing pull requests, and gathering customer feedback to drive product development. You will report directly to the CEO and later the Head of Engineering, playing a crucial part in shaping the future of LiteLLM's core product.

Responsibilities

  • Lead the unified API team, overseeing new model, endpoint, and provider rollouts.
  • Design provider-agnostic features for the gateway, such as session management.
  • Triage and manage open-source issues and pull requests, including new providers and translation fixes.
  • Review AI team pull requests, ensuring high code quality.
  • Identify power users and leverage their needs to inform future development.
  • Initiate and manage new unification efforts with customer feedback.
  • Own the developer experience for LiteLLM's Python SDK and proxy.

Requirements

  • 3+ years of experience, with scope of ownership being more important than title.
  • Deep expertise in LLM APIs and their nuances.
  • Experience building or maintaining a unified API across multiple providers.
  • Strong understanding of developer experience and API design.
  • Customer empathy and ability to assess use case impact.
  • Proven ability to lead a team and set technical direction.
  • Strong software engineering fundamentals in Python.
  • Experience with Python, FastAPI, Redis, and Postgres.
  • Familiarity with Rust is a plus.

Benefits

  • Competitive salary
  • Equity
  • Health, dental, and vision benefits
  • Relocation assistance
  • H-1B transfer support