Senior AI Infrastructure Systems Engineer (R&D / GPU / AI)
$180k - $224k • Remote • United States
Posted 4d ago
About the job
Nebius is building a full-stack AI cloud platform to support developers and enterprises in AI/ML infrastructure. This senior systems engineering role focuses on diagnosing and resolving complex hardware and platform failures in high-performance AI infrastructure. The engineer will work across Linux, GPU servers, PCIe, firmware, power, and cooling to determine the root cause of issues, developing new troubleshooting procedures for ambiguous problems. The role requires strong ownership, curiosity, and the ability to turn ambiguous problems into evidence-based conclusions.
Responsibilities
- Formulate technical hypotheses for hardware failures.
- Design and execute targeted tests to diagnose issues.
- Analyze system logs and low-level hardware data.
- Distinguish between GPU, host, firmware, interconnect, thermal, and physical hardware failures.
- Develop repeatable troubleshooting procedures for complex issues.
- Work across Linux, GPU servers, PCIe, firmware, power, and cooling systems.
- Perform root cause analysis and performance optimization in cloud or HPC environments.
- Benchmark systems for performance, stability, power efficiency, and thermal behavior.
Requirements
- Minimum 5 years of hands-on systems engineering experience.
- Extensive Linux experience, including hardware debugging and system-level troubleshooting.
- Knowledge of the Linux kernel and experience with kernel-level debugging.
- Strong knowledge of modern server architecture, especially in GPU-based environments.
- Strong knowledge of NVIDIA GPU platforms and diagnostic tooling (e.g., nvidia-smi, XID, GSP, NVLink, DCGM).
- Deep knowledge of PCIe topology, enumeration, errors, and physical layer issues.
- In-depth understanding of firmware interactions (BIOS/UEFI, BMC, CPLD/FPGA, GPU/NIC firmware).
- Experience with low-level hardware communication and debugging (I²C, SMBus, PMBus, register maps).
- Demonstrated ability to troubleshoot complex hardware, software, and networking issues.
- Scripting and automation skills using languages like Python or Go.
Benefits
- 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) plan with up to 4% company match and immediate vesting.
- 20 weeks paid parental leave for primary caregivers, 12 weeks for secondary caregivers.
- Up to $85/month reimbursement for mobile and internet for remote work.
- Company-paid short-term, long-term, and life insurance coverage.
- Competitive compensation.
- Career growth and learning opportunities.
- Flexibility and ownership.
- Collaborative and innovative culture.
- Opportunity to work on impactful AI projects.
- International environment and talented teams.
- Quarterly performance bonuses.