Pipeline Parallelism Jobs

Reflection ai

Reflection is a research lab dedicated to making intelligence open and accessible. We build open models that empower individuals to control their intelligence and shape the future of AI. As a Member of Technical Staff - Pre-Training Infra, you will be instrumental in building and scaling the distributed training systems that power frontier model pre-training. This role involves close collaboration with research teams to design and operate large-scale training runs for foundation models, and developing the infrastructure necessary for efficient training across thousands of GPUs.

As a Research Engineer on the Pre-training Systems team, you will design and operate the distributed infrastructure that trains Magic’s long-context models at scale. This role focuses on large-scale model training across massive GPU clusters, working at the boundary between deep learning and distributed systems to ensure training runs are performant, reliable, and reproducible under extreme scale. You will own the systems that make large-scale pre-training stable and fast, addressing challenges like sustained memory pressure, communication overhead across thousands of devices, long-running jobs that must survive failures, and efficient sequence packing under hardware constraints.

$275k - $550k