Large-scale systems Jobs

As a Research Engineer on the Pre-training Systems team, you will design and operate the distributed infrastructure that trains Magic’s long-context models at scale. This role focuses on large-scale model training across massive GPU clusters, working at the boundary between deep learning and distributed systems to ensure training runs are performant, reliable, and reproducible under extreme scale. You will own the systems that make large-scale pre-training stable and fast, addressing challenges like sustained memory pressure, communication overhead across thousands of devices, long-running jobs that must survive failures, and efficient sequence packing under hardware constraints.

$275k - $550k