AI Engineer
San Francisco • FullTime
Posted 1mo ago
Remote Work Policy
On-site
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
LiteLLM is seeking an AI Engineer to join their team and contribute to the development of the world's most popular AI Gateway. This role involves ensuring LiteLLM unifies the format for calling LLM APIs, specifically focusing on the OpenAI + Anthropic spec. You will be responsible for writing transformations to convert API requests and building provider-agnostic unification functionality. This is a critical role where you will work directly with the CEO and CTO on system design, developer experience, and building across LLMs, MCPs, and Agents.
Responsibilities
- Ensure LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec.
- Write transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats.
- Build provider-agnostic unification functionality, such as session management across non-openai models for /v1/responses API.
- Contribute to system design for supporting provider-level features at the gateway level (skills, compaction, batches, etc.).
- Focus on developer experience to support millions of users via LiteLLM's Python SDK.
- Build across LLMs, MCPs, and Agents by maintaining an excellent LLM interoperability layer.
- Support a wide range of MCP Auth flows and enable various Agent use-cases.
Requirements
- 1-2 years of backend/full-stack experience with production systems.
- Passion for open source and user engagement.
- Experience working with the OpenAI API, including understanding nuances between different endpoints.
- Strong work ethic and ability to thrive in small teams.
- Eagerness to talk to users and help solve real problems.
Benefits
- Competitive salary
- Equity
- Health benefits
- Dental benefits
- Vision benefits