Infrastructure Software Engineer, Enterprise GenAI
$216k - $270k • Remote • San Francisco, CA; New York, NY
Posted 2mo ago
Job Location
San Francisco, CA; New York, NY
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.
Responsibilities
- Architect multi-cloud systems and abstractions for the SGP platform.
- Implement custom integrations between Scale AI's platform and customer data environments.
- Collaborate with platform, product teams, and customers to develop and implement scalable infrastructure.
- Deliver experiments with high velocity and quality.
- Work across the entire product lifecycle from conceptualization through production.
- Be able to multi-task and learn new technologies quickly.
Requirements
- 4+ years of full-time engineering experience post-graduation.
- Experience scaling products at hyper-growth startups.
- Experience with LLMs, vector databases, and other AI technologies.
- Proficient in Python or Javascript/Typescript, and SQL.
- Experience with Kubernetes.
- Experience with major cloud providers (AWS, Azure, GCP).
- Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences.
Benefits
- Base salary
- Equity
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend