Fault Tolerance Jobs

Chai Discovery is building the computer-aided design suite for molecules, with major pharmaceutical companies already using their platform to accelerate drug discovery. They are at the forefront of reinventing life sciences through AI, developing frontier models that understand biochemical structure and interaction. This role is an opportunity to push the boundaries of AI drug design alongside a skilled and dedicated team.

As a Research Engineer on the Pre-training Systems team, you will design and operate the distributed infrastructure that trains Magic’s long-context models at scale. This role focuses on large-scale model training across massive GPU clusters, working at the boundary between deep learning and distributed systems to ensure training runs are performant, reliable, and reproducible under extreme scale. You will own the systems that make large-scale pre-training stable and fast, addressing challenges like sustained memory pressure, communication overhead across thousands of devices, long-running jobs that must survive failures, and efficient sequence packing under hardware constraints.

$275k - $550k