Infrastructure Engineer
Salary not listed • Bengaluru • Full-time
Posted 5d ago
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
Sarvam is building Indic-language AI for large-scale use, and the CPU Infrastructure team is responsible for all systems outside the GPU fleet. This includes managing Kubernetes across multiple cloud providers, the network infrastructure, identity and access management, observability, cost optimization, and the product delivery pipeline. The team operates on an end-to-end ownership model, where engineers are empowered to automate repetitive manual tasks by building scripts, pipelines, bots, or AI agents. As an AI company, Sarvam integrates AI agents into its own operations for tasks like planning infrastructure changes, triaging alerts, and handling routine issues, with engineers providing oversight.
In this role, you will ensure the smooth operation of Sarvam's product infrastructure, handling daily tasks such as deployments, provisioning, access control, incident response, and cost management. A key expectation is to automate these operational duties. The ideal candidate possesses an instinct for identifying manual processes and building automated solutions, whether through scripts, pipeline steps, bots, or AI agents. As you reduce operational toil, your focus will shift towards platform and automation development. You will contribute to the infrastructure supporting a variety of AI products, including voice agents, coding agents, and API platforms.
Responsibilities
- Own infrastructure operations including deployments, provisioning, access, environment issues, and cost management across Sarvam's products.
- Respond to incidents, document them with runbooks or postmortems, and implement fixes for root causes.
- Automate repetitive tasks by converting manual steps into pipeline jobs, Terraform modules, templates, or self-service tools for product teams.
- Develop AI-assisted automations, such as agents for triaging alerts, summarizing incidents, reviewing changes, or answering infrastructure questions, with human approval for critical actions.
- Manage security basics, including patching images and dependencies, rotating credentials, securing secrets, and resolving security findings.
- Ensure reliability basics by maintaining accurate dashboards and alerts, tracking SLOs and costs, and removing noisy alerts.
- Participate in on-call rotations.
Requirements
- 2-5 years of experience in DevOps, SRE, infrastructure, or backend engineering.
- Demonstrated experience building infrastructure outside of a formal ticket system (e.g., homelab, open-source contributions, side projects, internal tools), with code samples available.
- Proficiency with the Linux command line, including processes, networking, logs, and systemd.
- Working knowledge of Docker and Kubernetes, including experience deploying and debugging applications on a cluster.
- Scripting skills in Python, Go, or Bash.
- Basic experience with Git and CI/CD pipelines.
- Proven ability to identify and automate repetitive manual tasks, with the capacity to explain the process, impact, and outcome.
- Experience using LLMs or AI agents for automating real-world tasks beyond code generation.
- A proactive approach to fixing root causes rather than recurring symptoms, with a mindset of questioning manual processes.
- Curiosity, ownership, and a desire to grow into platform engineering.
- Nice to have: Terraform, experience with a public cloud (AWS, Azure, GCP), Prometheus/Grafana, exposure to SIP, WebRTC, or real-time media, or any cloud/Kubernetes certification.