Staff Infrastructure Software Engineer, Enterprise AI
$252k - $315k • Remote • New York, NY; San Francisco, CA
Posted 2mo ago
Job Location
New York, NY; San Francisco, CA
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
Scale GP is seeking a Senior or Staff Infrastructure Engineer to lead the engineering of the 'paved road' for knowledge retrieval and inference engines, defining deployment standards for Agentic workflows at scale. This role bridges complex AI orchestration with world-class infrastructure, ensuring platform reliability for enterprise agents. The ideal candidate is passionate about deep technical work, mentoring, and setting long-term technical strategy while maintaining a hands-on delivery focus. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in regulated industries.
Responsibilities
- Architect multi-cloud systems and abstractions to run the SGP platform on existing cloud providers.
- Analyze build/test logs and metrics using the company's data and AI platform to identify improvements.
- Define architectural patterns for multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows.
- Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD, test frameworks, data quality, reconciliation, and anomaly detection.
- Collaborate with platform and product teams to develop and implement scalable infrastructure.
- Design and champion highly scalable, reliable, and low-latency infrastructure for building, orchestrating, and evaluating multi-agent systems.
- Lead the infrastructure roadmap with a focus on compliance, privacy, and security standards, including change management and data isolation.
- Own the development and maintenance of the Agentic observability platform (logging, metrics, tracing, analytics).
- Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC).
Requirements
- Proven experience in a senior role with 5+ years of full-time software engineering experience.
- Deep understanding of modern infrastructure practices (CI/CD, IaC, container orchestration, observability platforms).
- Extensive experience with at least one major cloud provider (AWS, Azure, or GCP).
- Strong knowledge of security and compliance in enterprise environments (access management, data isolation, VPC setups).
- Proficiency in Python or JavaScript/TypeScript, and SQL.
- Hands-on experience with Agents, LLMs, vector databases, and other emerging AI technologies is a plus.
Benefits
- Base salary
- Equity
- Comprehensive health, dental, and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend (potential)