Aleph Alpha

Aleph Alpha is seeking a Senior Performance Engineer to join their pre-training efficiency team in Heidelberg. This role focuses on optimizing the systems required to train foundation models at scale, aiming to maximize hardware utilization and training throughput on large-scale GPU clusters. You will work at the intersection of deep learning frameworks, distributed systems, and GPU microarchitecture to eliminate bottlenecks from the Python layer down to the GPU kernel. The team fosters a culture of ownership, autonomy, and empowerment, with a flat organizational structure that enables quick decision-making and open communication.

Aleph Alpha is seeking a Senior AI Researcher to join our hallucination reduction capability team. This role focuses on pushing the boundaries of LLM post-training, specifically Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), to reduce model hallucinations and improve grounding in evidence. You will be part of a team conducting cutting-edge research on foundational models, with access to hundreds of GPUs, contributing to the development of trustworthy GenAI for industrial applications.

Aleph Alpha is seeking a Senior AI Researcher to join their Pre-training team, focusing on advancing the architecture and training of next-generation foundation models. This role involves designing inference-efficient architectures, optimizing large-scale training recipes, and working with thousands of NVIDIA GPUs. The position is ideal for someone excited about the intersection of research and engineering, translating mathematical reasoning into principled training decisions from small-scale experiments to large-scale runs. The researcher will influence model quality, run reliability, and efficiency by combining rigorous experimental design with high-quality production code.

Aleph Alpha is seeking exceptional Senior AI R&D Engineers to join our model training team. You will contribute to building and improving our foundation model pre- and post-training pipeline, which has been used to train Kolibri. This role involves working across the full stack, optimizing training schedules, enabling large-scale code execution for reinforcement learning, and enhancing evaluation codebases. You will have a direct influence on the development of our training pipeline and infrastructure, shaping how quickly we can experiment and improve our models. The position emphasizes identifying issues, taking initiative, and collaborating with team members on working modes, design decisions, and priorities.