HPC Systems Engineer
$147k - $196k • Costa Mesa, California, United States
Posted 17h ago
Job Location
Costa Mesa, California, United States
Tech Stack
Remote Work Policy
On-site
Categories
AI Infrastructure Engineer
About the job
Anduril Industries is seeking a High Performance Computing (HPC) System Engineer to directly support sensitive programs by building and maintaining large-scale HPC infrastructure. This role offers the opportunity to work with leading engineers and cybersecurity professionals on cutting-edge systems deployed globally for national security missions. You will be instrumental in architecting, deploying, and managing advanced GPU infrastructure, ensuring the seamless operation of critical compute environments.
Responsibilities
- Architect and deploy advanced GPU infrastructure, including NVIDIA H100, H200, and B200/B300 systems, managing their lifecycle.
- Rack, stack, cable, and configure physical servers and multi-node GPU systems.
- Configure HPC and AI environments, including job schedulers like Slurm, multi-user login environments, and cluster management software (Warewulf, NVIDIA Base Command, RunAI).
- Implement and fine-tune high-speed interconnects such as NVLink, NVSwitch, and InfiniBand/NDR for distributed training.
- Configure and manage large-scale, multi-petabyte storage platforms optimized for AI/ML data access.
- Install, configure, and maintain application stacks on HPC clusters, including simulation software (StarCCM+, Ansys, Matlab) and AI/ML software (NVIDIA drivers, CUDA, PyTorch, TensorFlow).
- Implement and manage GPU virtualization and sharing technologies like Multi-Instance GPU (MIG).
- Troubleshoot complex system-wide issues related to application performance, user access, compute nodes, storage, and job queueing.
- Monitor GPU health and performance using NVIDIA DCGM and other tools, resolving training bottlenecks.
- Ensure the security and integrity of server and cluster infrastructure through audits, patching, and security measures.
- Collaborate with engineering and AI/ML stakeholders to gather requirements and architect scalable solutions.
- Manage the hardware lifecycle, including procurement, quoting, and deployment scheduling.
- Provide technical guidance, mentoring, and architectural leadership to team members.
Requirements
- 5+ years of experience in designing, developing, and implementing large-scale compute enterprise systems.
- Strong knowledge and experience with High Performance Computing concepts, including cluster architecture, file systems, and high-speed interconnects (InfiniBand/Ethernet).
- Proven expertise in Red Hat Enterprise Linux, Ubuntu, HPC, GPU, Azure, or AWS cloud services.
- Strong understanding and experience with systems automation tools (Ansible, Salt, Puppet).
- Experience with HPC technologies such as parallel/distributed file systems (Lustre, GPFS, Pure, VAST).
- Working knowledge of HPC batch scheduler software (PBSPro, SLURM).
- Experience building HPC clusters on AWS/Azure.
- Ability to lift 50 lbs.
- Eligibility to obtain and maintain a US Top Secret Clearance.
Benefits
- Highly competitive equity grants
- Top-tier benefits package (available at little to no cost to employees)
- Comprehensive, competitive benefits package supporting health and recovery