Senior Principal Cloud Platform Engineer
INR 8900k - INR 10800k • Bengaluru, Karnataka, India • Full-time
Posted 4mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
Job Location
Bengaluru, Karnataka, India
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
SambaNova is seeking a Senior Principal Cloud Platform Engineer to set the technical direction for their AI inferencing platform, ensuring it remains reliable, fast, and scalable. This role focuses on optimizing uptime, latency, and resource utilization for customer-facing inference endpoints. The work involves monitoring, deployment, capacity planning, and incident response, with a shared on-call rotation for 24/7 coverage. The engineer will also act as a technical leader for the Bengaluru team, mentoring others and shaping platform practices across global regions.
Responsibilities
- Own the availability, latency, and efficiency of the production inferencing service, including change management, emergency response, and deploying AI infrastructure in new regions.
- Define the reliability and platform engineering strategy, including SLOs, error budgets, and multi-region architecture, and align stakeholders.
- Build and maintain monitoring, alerting, and dashboards in Prometheus, Grafana, and Datadog for service health, model performance, and RDU utilization.
- Lead incident response for high-severity events, conduct blameless post-mortems, and drive automation to fix systemic issues.
- Identify and resolve performance bottlenecks, and design auto-scaling and capacity planning policies for variable inference loads.
- Manage cloud and on-prem infrastructure as code using Terraform and Ansible, and architect CI/CD pipelines for model and service updates.
- Mentor SRE and platform engineers through design reviews, on-call practices, and knowledge sharing.
Requirements
- B.S. in Computer Science, Computer Engineering, or equivalent practical experience.
- 10+ years of experience in Site Reliability Engineering and Platform Engineering supporting large-scale, customer-facing services in public cloud environments (AWS, GCP, Azure).
- Proven technical leadership, including owning production system architecture and reliability, and mentoring engineers.
- Strong programming and scripting skills in Python, Go, or Java.
- Production experience with Docker and Kubernetes.
- Deep understanding of monitoring and observability tools (Prometheus, Grafana, Datadog, ELK Stack).
- Experience with infrastructure as code (Terraform or CloudFormation).
- Experience with CI/CD tooling (Jenkins, GitHub Actions, ArgoCD).
- Strong Linux system administration fundamentals.
Benefits
- Equity
- 95% premium coverage for employee medical insurance
- 77% premium coverage for dependents' medical insurance
- Health Savings Account (HSA) with employer contribution
- Dental insurance
- Vision insurance
- Short/Long term Disability insurance
- Basic Life insurance
- Voluntary Life insurance
- AD&D insurance
- Flexible Spending Account (FSA) options (Health Care, Limited Purpose, Dependent Care)
- Headspace subscription
- Gympass+ membership
- One Medical membership
- Counseling services with an Employee Assistance Program