Backend Engineer, Enterprise AI
New York, New York, United States
Posted 9h ago
About the job
Enterprise AI is building the platform that enables enterprises to deploy and operate AI systems in production. As a Backend Engineer, you will build the services and APIs behind the platform, including agent orchestration, model routing, enterprise integrations, identity and permissions, evaluation systems, and usage metering. You will help harden the platform for multi-tenant, enterprise-grade operation while building features that allow customers to configure and operate AI systems with greater independence.
Responsibilities
- Design, build, and operate backend services and APIs for agent orchestration, model routing, enterprise integrations, permissions, evaluation, and usage metering.
- Develop production systems using tool use, agent loops, retrieval, prompt versioning, and agent versioning.
- Build and maintain integrations with document stores, ticketing systems, data platforms, and other enterprise systems.
- Design data models, identity systems, permissions, and service boundaries for secure multi-tenant operation.
- Own features end-to-end, from architecture through implementation, testing, deployment, observability, and ongoing operation.
- Create reusable connectors, services, and agent capabilities for customers.
Requirements
- Six or more years of production backend or full-stack engineering experience on SaaS or enterprise platforms.
- Deep experience with Python or TypeScript services, API design, asynchronous job systems, and production operations.
- Hands-on experience with enterprise identity and permissions systems (OAuth, OIDC, SAML, SCIM) and multi-tenant data modeling/access control.
- Experience building production LLM features involving tool use, agent loops, retrieval, prompt versioning, or agent versioning.
- Experience integrating with document stores, ticketing systems, data platforms, or other enterprise systems.
- A track record of shipping LLM features used by paying customers and owning production systems after launch.
- Experience working on agent framework internals (preferred).
- Experience implementing SOC 2 or similar controls (preferred).
- Experience building integrations for financial services or other regulated industries (preferred).
- Experience building on OpenAI or Anthropic APIs in a production environment (preferred).