UCX Jobs

The Institute of Foundation Models (IFM) is seeking a deeply technical Senior Distributed Systems Engineer to co-design and optimize the communication stack for large-scale distributed training, including hybrid parallelism and Mixture-of-Experts (MoE) workloads. This systems-level engineering position focuses on performance engineering, distributed debugging, and communication-runtime co-design, aiming to improve performance, fault tolerance, and scalability across model architecture, communication systems, runtime, and hardware topology for ultra-scale GPU supercomputing systems.

$200k - $400k

OpenAI

As a Training Performance Engineer, you will be instrumental in enhancing the efficiency of our distributed training stack. Your responsibilities will include analyzing large-scale training runs, pinpointing utilization gaps, and devising optimizations to maximize throughput and uptime. This role requires a strong grasp of systems and practical performance engineering, involving the analysis of GPU kernel performance, collective communication throughput, investigation of I/O bottlenecks, and model sharding for massive-scale training. You will ensure our clusters operate at peak performance, enabling OpenAI to train larger, more capable models within existing compute budgets.

$295k - $500k