Member of Technical Staff, Infrastructure
Remote • San Francisco • FullTime
Posted 25d ago
Remote Work Policy
Fully remote
Employment Type
FullTime
Categories
AI Infrastructure Engineer
About the job
The Infra team at LlamaIndex is responsible for the foundational systems that power their AI product and the tools that enable engineers to develop, ship, and observe their code. They are seeking team members to design, build, and scale core infrastructure for a high-volume data platform for AI applications. The ideal candidate will have experience managing cloud infrastructure, navigating stages of scale, and empowering the engineering team. LlamaIndex values customer-obsession, collaboration, hard work, optimism, and ownership.
Responsibilities
- Collaborate with engineering teams to build and maintain foundational systems.
- Design and implement scalable infrastructure solutions for various deployment models.
- Manage and optimize cloud resources and Kubernetes clusters.
- Enable external customer deployment success by maintaining clear infrastructure boundaries.
- Optimize and improve release and deployment processes.
- Ensure regulatory compliance and implement security measures.
- Build and operate infrastructure for production LLM applications, including model integrations, inference, evaluation, observability, and agentic workflows.
Requirements
- 8+ years of engineering experience.
- Experience on Platform or Infrastructure teams with significant projects involving components like Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, and observability.
- Experience optimizing cloud resource utilization.
- Proficiency in tuning Kubernetes clusters and cloud resources for cost and performance.
- Willingness to contribute to LlamaIndex's engineering culture.
- Ability to balance speed and pragmatism in building solutions.
- Hands-on proficiency with modern LLM tooling and production AI systems, including model APIs, agent or RAG frameworks, evaluation and tracing tools, and LLM workload operational characteristics.
Benefits
- Competitive base salary and equity compensation
- Comprehensive medical/dental/vision coverage
- Unlimited paid time off policy
- Daily catered lunch and snacks in the San Francisco office