GPU Cluster Architect
$184k - $318k • Remote • Remote - United States
Posted 4d ago
About the job
Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.
Responsibilities
- Architect scalable GPU cluster topologies including compute nodes, interconnect, storage, and control planes.
- Analyze AI/ML workloads to inform design tradeoffs across latency, bandwidth, and GPU density.
- Validate low-latency, high-throughput interconnects at POD and DC scale.
- Optimize storage performance for training datasets and checkpointing.
- Analyze monitoring system data to detect design flows.
- Partner with site reliability, networking, storage, and DC engineering teams to operationalize and scale the architecture.
Requirements
- 5+ years of experience designing clusters.
- Deep understanding of modern GPU architecture (NVIDIA, AMD, etc.).
- Experience with HPC interconnects (InfiniBand & RoCE).
- Solid background in systems architecture, networking, and hardware reliability.
- Experience in scripting for automation and telemetry pipelines (Python, Go, etc.).
Benefits
- 100% company-paid medical, dental, and vision coverage for employees and families.
- Up to 4% company match with immediate vesting for 401(k) plan.
- 20 weeks paid parental leave for primary caregivers, 12 weeks for secondary caregivers.
- Up to $85/month for mobile and internet reimbursement for remote work.
- Company-paid short-term, long-term and life insurance coverage.
- Equity in the form of RSUs may be available.
- Opportunities for professional growth.
- Flexibility and ownership.
- Collaborative and innovative culture.