Infrastructure Software Engineer, Enterprise GenAI

$179k - $224k • Remote • San Francisco, CA; New York, NY

Posted 7d ago

Remote Work Policy

Fully remote

Categories

AI Infrastructure Engineer

About the job

Scale Generative AI Platform (SGP) is seeking a skilled engineer to join its team and contribute to building and scaling its core infrastructure. This role involves implementing solutions across multiple cloud providers (GCP, Azure, AWS) for clients in regulated industries such as healthcare, telecom, finance, and retail. The ideal candidate will possess a strong foundation in software engineering principles and experience with large-scale distributed systems.

Responsibilities

  • Architect multi-cloud systems and abstractions for the SGP platform.
  • Implement custom integrations with customer data environments, including cloud platforms and data warehouses.
  • Collaborate with platform, product teams, and customers to develop scalable infrastructure.
  • Deliver experiments with high velocity and quality.
  • Manage the product lifecycle from conceptualization to production.
  • Multitask effectively and quickly learn new technologies.

Requirements

  • 4+ years of full-time engineering experience post-graduation.
  • Experience scaling products in hyper-growth startup environments.
  • Experience with LLMs, vector databases, and other AI technologies.
  • Proficiency in Python or Javascript/Typescript, and SQL.
  • Experience with Kubernetes.
  • Experience with major cloud providers (AWS, Azure, GCP).
  • Excellent communication skills for explaining technical concepts.

Benefits

  • Base salary
  • Equity
  • Comprehensive health, dental, and vision coverage
  • Retirement benefits
  • Learning and development stipend
  • Generous PTO
  • Commuter stipend (potential)

About Scale AI

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.