Senior AI Product Engineer, Backend
$125k - $225k • Remote • Remote (United States)
Posted 24d ago
Job Location
Remote (United States)
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Product Engineer
About the job
Arize AI is seeking a Senior AI Product Engineer, Backend to join their core team driving product innovation. This role involves building and optimizing the highly scalable distributed services that power Arize's AI and Agent Engineering observability and evaluation platform. You will work on challenging technical problems, from efficient metric computation across billions of data points to designing next-generation OLAP database architectures and implementing advanced dimensionality reduction techniques. The position offers the opportunity to understand how leading engineering teams develop AI and LLM-powered applications and to build the tools that enable them to succeed.
Responsibilities
- Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
- Build high-volume and highly available analytics systems.
- Design and build APIs specific to customer Machine Learning and LLM workflows.
- Prototype, optimize, and maintain scalable backend services for the Arize core platform.
- Extend and contribute to open-source OLAP databases and distributed message queue frameworks.
- Develop and integrate collection tools for monitoring ML and LLM pipelines.
- Research and implement cutting-edge visualization and dimensionality reduction algorithms in a distributed environment.
- Collaborate with product, design, and customer engineering teams to enhance product offerings.
- Contribute to building in-house AI Agents.
Requirements
- 5+ years of experience with high-performance backend systems.
- Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
- Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn emerging technologies.
- Previous work building and operating highly complex SaaS platforms/systems.
- Knowledge of working with public clouds and container orchestration (AWS, GCP, Azure, Kubernetes, etc.).
Benefits
- Competitive equity package
- Medical, dental, and vision insurance
- 401(k) plan
- Unlimited paid time off
- Generous parental leave plan
- Support for mental health and wellness
- WFH monthly stipend for co-working spaces