RoCEv2 Jobs

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.

$184k - $318k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This is an architect-and-build role where you will set the architecture for automated bootstrapping of GPU data centers, high-performance virtualization, and fault-tolerant decentralized control planes, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer up to the global management plane that schedules capacity across all data centers. At this level, the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships.

$260k - $300k