Principal Site Reliability Engineer
Remote • US, CA, Santa Clara
Posted 1mo ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
NVIDIA's Site Reliability Engineering (SRE) team is seeking a Principal SRE to shape the technical direction of the company's AI Platform Runtime. This role involves leading reliability engineering initiatives across multiple organizations, solving complex enterprise-scale problems, and establishing architectural standards for critical AI-powered services. The Principal SRE will also drive the adoption of AI agents and skills to enhance platform operations and developer productivity. The team values intellectual curiosity, diversity, collaboration, and continuous learning through blameless analysis, encouraging bold thinking and impactful improvements.
Responsibilities
- Define and drive the long-term technical vision, architecture, and roadmap for reliability across NVIDIA’s AI Platform Runtime and related enterprise systems.
- Architect highly available, resilient, secure, and scalable distributed platforms for AI-driven products and services.
- Lead the design and development of AI agents, AI skills, and intelligent automation for platform operations, incident response, and remediation.
- Establish platform-wide reliability standards, including SLOs, error budgets, capacity models, resilience patterns, and operational readiness.
- Identify systemic risks and lead cross-functional programs to improve availability, scalability, performance, security, and developer productivity.
- Advance observability across complex distributed environments using OpenTelemetry, metrics, logs, traces, profiling, analytics, and automated anomaly detection.
- Partner with senior leaders and engineers across Cloud, Platform, Security, Networking, and AI/ML organizations on architectural and investment decisions.
- Provide technical leadership during critical incidents and ensure lessons learned lead to durable improvements.
- Develop reference architectures, shared platform capabilities, and automation frameworks for adoption across engineering organizations.
- Influence, mentor, and raise the technical bar for senior engineers and technical leaders.
Requirements
- 15+ years of experience in Site Reliability Engineering, Platform Engineering, Distributed Systems, Cloud Architecture, or related infrastructure engineering.
- BS or MS degree in Computer Science or a related technical field, or equivalent experience.
- Demonstrated experience setting technical strategy and leading large-scale engineering initiatives across multiple teams or organizations.
- Deep expertise in distributed systems architecture, networking, Linux, Kubernetes, and public cloud platforms (AWS, Azure, GCP).
- Strong proficiency in Python, Go, TypeScript, JavaScript, or Java, with experience building production-grade automation and platform software.
- Extensive experience with infrastructure-as-code and platform automation technologies (Terraform, Crossplane, AWS CDK, CloudFormation, or equivalent).
- Deep understanding of observability at scale, including OpenTelemetry and modern metrics, logging, tracing, profiling, and analytics platforms.
- Expertise in reliability engineering practices (SLOs, error budgets, capacity planning, fault tolerance, disaster recovery, incident management, blameless postmortems).
- Track record of delivering measurable improvements in availability, performance, operational efficiency, or engineering productivity.
- Outstanding technical judgment, communication, and collaboration skills, with the ability to influence senior stakeholders.