Distributed Training Jobs
95 open roles mentioning Distributed Training
Research Engineer / Scientist - Reinforcement Learning
Prime Intellect
Prime Intellect is building the open superintelligence stack, a full-stack system for post-training at frontier scale, from SFT and RL to tool use and agent workflows. We are developing open-source models trained end-to-end for long-horizon tasks like autonomous research, and the platform our own research team uses to build them. We are seeking individuals passionate about building at the intersection of frontier research, real infrastructure, and go-to-market for a nascent category. This role will focus on developing the algorithms and systems used to train our open models with reinforcement learning, with opportunities to specialize in RL algorithms, scaling research, or training frameworks.
$150k - $350k
Senior High Performance AI Engineer
nvidia
NVIDIA is seeking a Senior High Performance AI Engineer to develop groundbreaking multi-agent systems within the CUDA ecosystem. This role involves building innovative agentic runtimes and compiler-integrated orchestration that leverage NVIDIA's software stack to accelerate modern agent workloads powered by foundational models. You will contribute to new agent abstractions, GPU-centric runtimes, and system solutions that enhance agent planning, tool-use, and code generation. The position requires close collaboration with internal NVIDIA software and hardware teams to integrate cutting-edge developments into NVIDIA products.
$184k - $357k
Senior AI R&D Engineer - Performance - Pre-training (f/m/d)
Aleph Alpha
Aleph Alpha is seeking a Senior Performance Engineer to join their pre-training efficiency team in Heidelberg. This role focuses on optimizing the systems required to train foundation models at scale, aiming to maximize hardware utilization and training throughput on large-scale GPU clusters. You will work at the intersection of deep learning frameworks, distributed systems, and GPU microarchitecture to eliminate bottlenecks from the Python layer down to the GPU kernel. The team fosters a culture of ownership, autonomy, and empowerment, with a flat organizational structure that enables quick decision-making and open communication.
Senior AI Researcher: LLM post-training for hallucination reduction (f/m/d)
Aleph Alpha
Aleph Alpha is seeking a Senior AI Researcher to join our hallucination reduction capability team. This role focuses on pushing the boundaries of LLM post-training, specifically Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), to reduce model hallucinations and improve grounding in evidence. You will be part of a team conducting cutting-edge research on foundational models, with access to hundreds of GPUs, contributing to the development of trustworthy GenAI for industrial applications.
Member of Technical Staff - Post-Training (Reinforcement Learning & Generalization)
Cohere
Cohere is seeking a Member of Technical Staff to focus on post-training large language models (LLMs) using reinforcement learning and developing methods for improved generalization. This role involves designing training recipes, environments, and evaluations to ensure models learn skills effectively and generalize beyond their training data. You will collaborate with data infrastructure, evaluation, and pre-training teams to translate research findings into robust training procedures for production models. The ideal candidate is passionate about advancing AI capabilities and contributing to the widespread adoption of AI in enterprise solutions.
CA$295k - CA$535k
PhD Research Intern, Physical AI - Foundation Models - 2027
nvidia
NVIDIA is developing world foundation models and generative AI systems for Physical AI applications, including robotics, autonomous driving, smart spaces, and embodied agents. The NVIDIA Cosmos Platform facilitates multimodal world understanding, simulation, synthetic data generation, and embodied reasoning. We are seeking talented PhD interns to contribute to advancements in Physical AI and world models. This role involves conducting research, developing algorithms, training and evaluating large-scale models, collaborating with cross-functional teams, and publishing research findings.
$0k - $0k
PhD Research Intern, Efficient Deep Learning - 2027
nvidia
NVIDIA is seeking a PhD intern to join the Deep Learning Efficiency Research (DLER) team, focusing on research that pushes boundaries and has real-world impact. The team's core areas include efficient diffusion language and multimodal generative models, as well as efficient agentic AI with hybrid inference orchestration. We are also interested in post-training model optimization, efficient architecture design, adaptive inference, and resource-efficient training and finetuning. You will collaborate with a research team that consistently publishes at top venues, contributing to technologies that can impact NVIDIA's products.
$0k - $0k
PhD Research Intern, Generative AI - 2026
nvidia
NVIDIA is developing advanced foundation models and generative AI systems for Physical AI applications, including robotics, autonomous driving, smart spaces, and embodied agents. The NVIDIA Cosmos Platform facilitates multimodal world understanding, simulation, synthetic data generation, and embodied reasoning. We are seeking talented PhD interns to contribute to the advancement of Physical AI and world models.
$0k - $0k
Senior Software Engineer, JAX
nvidia
NVIDIA is seeking senior engineers to enhance its AI platform, focusing on performance optimizations within deep learning frameworks like JAX. The goal is to create a robust, efficient, and scalable platform for data handling, training, and analysis across various deep learning solutions. This role requires strong programming and system design skills, along with excellent communication and planning abilities, to contribute to the next generation of numerical computing and machine learning research tools.
$184k - $357k
Senior AI Researcher- Pre-training (f/m/d)
Aleph Alpha
Aleph Alpha is seeking a Senior AI Researcher to join their Pre-training team, focusing on advancing the architecture and training of next-generation foundation models. This role involves designing inference-efficient architectures, optimizing large-scale training recipes, and working with thousands of NVIDIA GPUs. The position is ideal for someone excited about the intersection of research and engineering, translating mathematical reasoning into principled training decisions from small-scale experiments to large-scale runs. The researcher will influence model quality, run reliability, and efficiency by combining rigorous experimental design with high-quality production code.
Senior AI Platform Engineer
Code Metal
Code Metal is seeking a Senior Software Engineer for its AI Platform team. This role involves designing, building, and operating the foundational AI enablement stack that powers the company's AI-driven code solutions. You will contribute to critical components such as GPU inference serving, model gateways, agent harnesses, context engineering, observability, and AI experimentation management. While this is an internal platform, it is built to product standards. The position offers the opportunity to eventually own a specific area, like model serving or agentic infrastructure, while also contributing broadly across the stack. The role requires a blend of strong software engineering skills with solid data science and AI research fundamentals, including occasional experimental work to inform platform decisions.
$170k - $210k
Technical Lead Manager - Platform Engineering
llamainndex ai
LlamaIndex is seeking a Head of Engineering to lead and develop their engineering team in building software that makes enterprise data useful for AI applications. This is a hands-on role where you will own engineering execution, technical direction, hiring, and team development. You will collaborate closely with company leadership and product teams to define product strategy and delivery. The ideal candidate has shipped and operated B2B API products, with experience in both model serving and model training, from experimentation and evaluation to deployment and production operations.
$200k - $300k
Research Scientist / Engineer – Training Infrastructure
lumalabs
Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.
$195k - $395k
Research Scientist / Engineer – Training Infrastructure
lumalabs
Luma is seeking a Research Scientist / Engineer to build and optimize the distributed systems that train large-scale multimodal models across thousands of GPUs. This role focuses on advanced parallelism, training stability, and utilization across massive clusters, requiring deep expertise in distributed PyTorch and CUDA. The goal is to provide researchers with reliable, efficient, and scalable infrastructure for innovation.
Sr./Staff Network Design Engineer, AI/HPC
Groq
Groq is building high-performance AI infrastructure designed to make inference fast, predictable, and scalable. Our infrastructure teams design and operate the systems that connect compute, data, and services at significant scale. We are looking for a Sr./Staff Network Engineer, AI/HPC to help architect, design, validate, and evolve the network infrastructure supporting Groq's rapidly growing AI compute environments. As a Sr./Staff Network Design Engineer, you will own network architecture and design across high-performance data center and AI infrastructure environments. You will translate capacity, performance, reliability, and business requirements into scalable network designs that can be deployed and operated consistently. This role requires deep expertise in data center networking, routing protocols, network architecture, automation, and large-scale infrastructure. You will work closely with network operations, data center engineering, compute, platform, security, and infrastructure teams to take designs from concept through validation and production deployment.
$270k - $366k
ML Engineer, LLM's
Knowtex
Knowtex is seeking an ML Engineer / Researcher focused on Large Language Models to contribute to the next generation of their AI stack. This role involves developing and optimizing models for clinical documentation and structured clinical reasoning, aiming to enhance quality, cost, latency, and control. The position is research-heavy with a direct path to production, requiring the design of experiments, building datasets and evaluation systems, and fine-tuning and post-training models. The successful candidate will collaborate closely with engineering and clinical teams to deploy solutions at scale and will play a key role in shaping Knowtex's long-term LLM strategy.
Senior Machine Learning Engineer - Generative Models
Applied Intuition
We are seeking senior machine learning engineers to advance the generative modeling technology behind our Neural Simulation product. This role involves pushing the boundaries of diffusion and video generation models to create realistic, controllable sensor data and augment real-world logs with new scenarios. Your work will directly influence the development of next-generation data-driven autonomous vehicles for leading OEMs. This position is ideal for engineers passionate about the intersection of generative modeling, computer vision, and machine learning, who are eager to bring cutting-edge research into production and address complex simulation challenges in Physical AI.
$185k - $260k
Member of Technical Staff (Machine Learning Engineer, Search Agent RL)
Perplexity AI
Perplexity is seeking an experienced Machine Learning Engineer to advance how AI systems search, reason, and work together to solve complex problems. Our work spans search and retrieval, LLM post-training, multi-agent training, and the harnesses that make these systems effective. We control the full stack, giving us the freedom to develop new approaches across models, agent harnesses, and search infrastructure to use search more effectively, design tools and execution environments around learned behavior, and improve retrieval to support how agents actually work.
Machine Learning Engineer — Reinforcement Learning
Institute of Foundation Models
We are a dedicated research lab focused on building, understanding, using, and risk-managing foundation models. Our mission is to advance AI research, cultivate the next generation of AI builders, and make significant contributions to a knowledge-driven economy. As part of our team, you will work on the core of cutting-edge foundation model training alongside world-class researchers, data scientists, and engineers. You will tackle fundamental and impactful challenges in AI development, contributing to groundbreaking AI solutions that have the potential to reshape industries. Strategic and innovative problem-solving skills are essential for establishing our institution as a global hub for high-performance computing in deep learning.
$150k - $450k
Machine Learning Engineer — Pre-training (LLM)
Institute of Foundation Models
We are a dedicated research lab focused on building, understanding, using, and risk-managing foundation models. Our mission is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you will have the opportunity to work on the core of cutting-edge foundation model training alongside world-class researchers, data scientists, and engineers. You will tackle fundamental and impactful challenges in AI development, participating in the creation of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills are essential for establishing our institution as a global hub for high-performance computing in deep learning.
$150k - $450k
