Member of Technical Staff, Enterprise Foundations
Remote • New York • FullTime
Posted 1mo ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
Applied AI Engineer
About the job
Enterprise Foundations is responsible for building the core capabilities that large enterprises require to operate their business on the Fireworks platform. This involves addressing complex needs related to organizational structure, user access control, usage metering, billing, data security, and deployment within customer-owned cloud environments. The role offers end-to-end ownership of features, starting from customer conversations, evolving into changes in core data models and APIs, and extending through the control plane, training and inference stacks, SDK, CLI, and console. The work is foundational, often involving new primitives that impact other teams' code and must be rolled out to production without disruption. This position is closely tied to revenue, with requirements stemming directly from enterprise deals and customer interactions, offering a unique opportunity to influence product direction and build solutions for scaled companies.
Responsibilities
- Own foundational capabilities end-to-end, including data models, APIs, control plane, runtime, SDK/CLI, and console, and migrate live systems onto them.
- Design primitives for large customer organization, including organizations, sub-accounts, groups, roles, and service identities, and integrate with enterprise directories via federation and provisioning (SSO, SCIM).
- Design multi-tenant authorization, policy enforcement, and audit systems suitable for enterprise security architects.
- Ensure accurate and legible usage metering, spend controls, and billing at scale, enabling customers to reconcile financial data.
- Manage data isolation and key management, including customer-managed encryption keys across AWS, GCP, and Azure, for datasets, fine-tuning, RL, checkpoints, models, and inference.
- Deploy and operate Fireworks within customer-owned clouds, addressing data residency and regional isolation requirements.
- Aggressively utilize AI tooling to automate tasks and processes.
Requirements
- 4+ years of experience building and operating large-scale production backend or distributed systems.
- Strong server-side engineering skills in Go, Python, C++, TypeScript, or similar, with a willingness to work across different layers.
- Experience designing and evolving APIs and data models under live traffic without impacting callers.
- Hands-on experience with at least one major cloud provider (AWS, GCP, or Azure), including IAM, workload identity, KMS, object storage, and VPC networking.
- Proven track record of owning ambiguous, cross-team workstreams from requirements to production.
- Willingness to engage directly with customers.
- Experience with enterprise identity and tenancy concepts such as SSO, SCIM provisioning, RBAC/ABAC, audit logging, and organization modeling.
- Experience with metering, quotas, or billing systems where accuracy is critical.
- Familiarity with applied cryptography and key management, including envelope encryption, KMS, and threat modeling.
- Depth in Kubernetes and fluency in infrastructure-as-code (Terraform, GitOps).
- Familiarity with LLM inference and fine-tuning.