PyTorch Profiler Jobs

Aleph Alpha is seeking a Senior Performance Engineer to join their pre-training efficiency team in Heidelberg. This role focuses on optimizing the systems required to train foundation models at scale, aiming to maximize hardware utilization and training throughput on large-scale GPU clusters. You will work at the intersection of deep learning frameworks, distributed systems, and GPU microarchitecture to eliminate bottlenecks from the Python layer down to the GPU kernel. The team fosters a culture of ownership, autonomy, and empowerment, with a flat organizational structure that enables quick decision-making and open communication.