Senior HPC Cluster Engineer
Salary not listed • Remote • Madrid, Spain; Remote - Europe; United Kingdom • Full-time
Posted 1y ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
Job Location
Madrid, Spain; Remote - Europe; United Kingdom
Tech Stack
Remote Work Policy
Fully remote
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a Senior HPC Cluster Engineer to join our GPU & InfiniBand team. This role is crucial for enhancing and optimizing the core components of our Cloud platform, with a specific focus on GPU computing, InfiniBand networks, and the KVM/QEMU stack. You will work with hardware virtualization and device emulation technologies to ensure high performance and security in multi-GPU, HPC environments. The position involves analyzing, troubleshooting, and improving infrastructure to support new hardware, fine-tuning system performance, and automating fault detection and resolution in a complex system.
Responsibilities
- Tune the performance of GPU clusters and InfiniBand networks for optimal operation in HPC and GPU-based environments.
- Analyze and troubleshoot root causes of issues related to GPUs and InfiniBand networks, and propose corrective actions.
- Integrate new hardware into existing infrastructure, including support for new GPU hardware through software stacks like Kubernetes, QEMU, and KVM.
- Enhance automation systems for proactive monitoring, detection, and resolution of issues in GPU and InfiniBand environments.
- Configure and manage GPU devices and InfiniBand fabrics for efficient and reliable operation.
Requirements
- 5+ years of professional experience in system-level software development, focused on performance optimization and low-level programming.
- 3+ years of hands-on experience with Linux systems (administration, troubleshooting, and performance tuning).
- In-depth understanding of server architecture, including PCIe devices, NICs, Linux OS/Kernel, and high-performance computing (HPC) systems.
- Strong proficiency in one or more performance-oriented programming languages (C/C++, Go, Python).
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams