Senior Infrastructure Software Engineer, Enterprise AI
$216k - $270k • Remote • New York, NY; San Francisco, CA
Posted 7d ago
Job Location
New York, NY; San Francisco, CA
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior Infrastructure Engineer to act as a primary technical lead, engineering the 'paved road' for our knowledge retrieval and inference engines. You won't just be managing resources; you’ll be defining the deployment standards for Agentic workflows at scale. Your mission is to bridge the gap between complex AI orchestration and world-class infrastructure, ensuring our platform remains the most reliable destination for enterprise agents. The ideal candidate thrives in a fast-paced environment, has a passion for both deep technical work and mentoring, and is capable of setting a long-term technical strategy for a critical domain while maintaining a strong, hands-on delivery focus. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.
Responsibilities
- Architect multi-cloud systems and abstractions to run the SGP platform on existing cloud providers.
- Analyze build and test logs and metrics using the company's data and AI platform to identify improvements.
- Define architectural patterns for multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows.
- Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD, test frameworks, data quality, reconciliation, and anomaly detection.
- Collaborate with platform and product teams to develop and implement scalable infrastructure.
- Design and champion highly scalable, reliable, and low-latency infrastructure for building, orchestrating, and evaluating multi-agent systems.
- Lead the infrastructure roadmap with a focus on compliance, privacy, and security standards, including change management and data isolation.
- Own the development and maintenance of the Agentic observability platform (logging, metrics, tracing, analytics) for system health and incident response.
- Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms.
Requirements
- 5+ years of full-time software engineering experience in a senior role.
- Deep understanding of modern infrastructure practices (CI/CD, IaC, container orchestration, observability platforms).
- Extensive experience with at least one major cloud provider (AWS, Azure, or GCP).
- Strong knowledge of security and compliance in enterprise environments (access management, data isolation, VPC setups).
- Proficiency in Python or JavaScript/TypeScript, and SQL.
- Hands-on experience and passion for working with Agents, LLMs, vector databases, and other emerging AI technologies.
Benefits
- Base salary
- Equity
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend