New: upload your resume and get matched to AI jobs. Free to start →

AI Infrastructure System Engineer

India • Full-time

Posted 2d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

Accountabilities

Design and develop fleet automation systems to provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.

Build AI infrastructure agents that automate deployments, identify root causes of failures, support incident triage, and execute autonomous remediation.

Develop fleet intelligence platforms to monitor hardware health, firmware, networking, storage, thermal conditions, and workload performance, enabling predictive failure detection.

Create software solutions that maximize GPU availability, utilization, performance, and reliability across large-scale accelerator fleets.

Build automated validation systems for GPUs, InfiniBand and RoCE networks, NVLink and NVSwitch technologies, storage infrastructure, and distributed AI workloads.

Develop internal platforms and tools that enable infrastructure teams to manage systems programmatically rather than relying on manual operations.

Continuously improve deployment speed, operational efficiency, and infrastructure reliability through automation and system optimization.

Collaborate with hardware, networking, platform, and AI engineering teams to advance the capabilities of large-scale AI infrastructure.

Requirements:

At least 3 years of experience building distributed systems, infrastructure platforms, or large-scale backend software.

Strong software engineering skills in at least one of the following languages: Python, Go, or Rust.

Practical experience developing platforms, automation systems, or developer infrastructure.

Familiarity with Linux and infrastructure technologies such as Kubernetes, Terraform, Ansible, or similar tools.

Strong systems-thinking abilities, with the capacity to understand and troubleshoot challenges spanning both hardware and software.

A passion for solving complex infrastructure problems through software engineering.

An automation-first mindset, with a strong preference for building systems that eliminate repetitive tasks and manual processes.

Bonus Experience:

Experience with GPU infrastructure, CUDA, NCCL, NVLink, or NVSwitch.

Knowledge of InfiniBand or RoCE networking technologies.

Experience with bare-metal provisioning and infrastructure lifecycle management.

Exposure to large-scale AI training or inference clusters.

Familiarity with hardware health monitoring and predictive failure detection.

Experience with distributed storage systems.

Knowledge of AI agents and autonomous infrastructure operations.

Benefits:

Opportunity to work on large-scale GPU infrastructure supporting advanced AI training and inference.

Exposure to complex engineering challenges across distributed systems, hardware, networking, and AI platforms.

Opportunity to build software and automation systems operating across thousands of accelerators.

Close collaboration with multidisciplinary engineering teams.

Professional growth through hands-on experience with emerging AI infrastructure technologies.