Senior Software Engineer, Inference
$190k - $225k • Remote • North America
Posted 1mo ago
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
AssemblyAI is seeking a Software Engineer to bridge the gap between cutting-edge AI research and production-ready products. You will join a dynamic engineering team responsible for transforming new model capabilities from initial concepts into robust, well-documented APIs that handle production traffic at scale. This role involves designing and launching customer-facing APIs, scaling inference infrastructure, and collaborating with researchers and customers to ensure our products meet user needs and drive future development.
Responsibilities
- Design and ship customer-facing APIs, managing them from prototype to launch and iteration.
- Scale inference infrastructure to support a large user base.
- Productionize new AI techniques by converting research prototypes into reliable, low-latency systems.
- Collaborate with customers and applied teams to gather feedback for product and research direction.
- Contribute to various parts of the stack, including backend services, inference infrastructure, SDKs, and internal tooling.
Requirements
- Strong backend engineering experience, with a focus on building and supporting machine learning infrastructure and/or customer-facing APIs in production.
- Comfort operating in ambiguous environments where research and product timelines may not align.
- Genuine curiosity about AI/ML, with the ability to understand model behavior to make informed engineering decisions.
- Strong collaboration skills for working effectively with researchers, applied engineers, and customers.