Triton Jobs

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.

$200k - $400k

CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.

$92k - $135k

CoreWeave is seeking a Principal Engineer to lead its Benchmarking & Performance team. This role will be responsible for a global performance data warehouse, ingesting, storing, transforming, and analyzing performance events across all data centers. You will also play a key part in industry-leading performance benchmarking publications, working closely with NVIDIA and the open-source community to demonstrate CoreWeave's performance and reliability leadership in AI.

$206k - $333k

NVIDIA is seeking a motivated Deep Learning engineer to integrate advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will work with the team that created communication libraries like NCCL and NVSHMEM, and technology like GPUDirect, to scale Deep Learning and HPC applications. Your work will directly impact AI application performance by improving communication between GPUs, making AI toolkits easier for the community to use. This role offers an outstanding opportunity for someone with an AI background to advance the state of the art in this space.

$184k - $357k

SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.

$180k - $440k

NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.

$124k - $242k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. As a Senior Machine Learning Engineer on the Applied AI team, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization, model compression, speculative decoding, KV-cache optimization, inference engines, and serving architecture to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving model quality and reliability. You will collaborate with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions, validating improvements through reproducible benchmarks and safe production rollouts.

$195k - $262k

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy, from data and model training through to production deployment. The Nebius Token Factory is seeking scientists to tackle frontier LLM and VLM inference bottlenecks by turning them into research questions, conducting rigorous experiments, and translating findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts for engineers to build upon. Your research will cover areas like quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will evaluate trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and collaborate with engineering teams to bring promising results into production.

$195k - $262k

NVIDIA's TensorRT team is seeking talented engineers to advance high-performance AI inference on NVIDIA GPUs. This role focuses on developing software that accelerates state-of-the-art generative AI models for local and enterprise deployments. You will tackle challenging problems in GPU code generation, just-in-time compilation, and inference optimization to deliver high performance across diverse models and hardware configurations. As a Senior Software Engineer, you will design and implement advanced GPU inference software, translating a deep understanding of GPU execution into efficient code generation and measurable improvements in generative AI inference.

$152k - $288k

As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.

$131k - $197k

NVIDIA is seeking a Senior Performance Compiler Engineer to join their open-source Triton compiler project. This role focuses on improving AI performance on NVIDIA GPUs by leveraging compiler technology. You will work on cutting-edge AI applications, including large language models and agents, accelerating both training and inference. The position offers a collaborative and supportive environment to push the boundaries of AI computing.

$184k - $288k

Prime Intellect is building the open superintelligence stack, a platform designed to unify compute, environments, evaluations, and deployment for frontier-scale AI development. We are creating open-source models trained for long-horizon tasks and the full-stack platform our research team uses to build them. We are looking for individuals passionate about building at the intersection of frontier research, real infrastructure, and go-to-market for a nascent category.

$150k - $350k

NVIDIA is seeking an Engineering Manager to lead the strategy for verifying AI compilers for next-generation deep learning workloads. This role involves managing a technical team focused on AI compiler verification, ensuring the quality of AI compilers that optimize deep learning models for GPU execution. The position requires a deep understanding of compiler quality challenges at the intersection of compilers, machine learning frameworks, numerical computing, formal reasoning, and large-scale systems engineering.

$168k - $322k

NVIDIA is seeking a Senior Deep Learning Software Engineer to join their Algorithmic Model Optimization Team. This role focuses on optimizing generative AI models, including LLMs and diffusion models, for maximum inference efficiency. The team utilizes techniques like neural architecture search, pruning, sparsity, and quantization, and develops an innovative software platform for automated deployment. The engineer will contribute to applied research and the development of this software, which is used both internally at NVIDIA and externally by other AI development teams. This is an opportunity to push the boundaries of inference efficiency and large-scale automated deployment, working with high-level frameworks and improving high-performance kernel implementations.

$184k - $357k

Luma is seeking a Research Scientist/Engineer to focus on optimizing the performance of their multimodal models. This role involves profiling and enhancing GPU, CPU, and accelerator code to ensure efficient training and scalable deployment without compromising quality. You will be responsible for writing kernels and operations that maximize hardware utilization and minimize latency, requiring deep expertise in GPU optimization, transformer internals, and low-level programming.

$195k - $395k

Luma is seeking a Research Scientist/Engineer to focus on optimizing the performance of their multimodal models. This role involves profiling and enhancing GPU, CPU, and accelerator code to ensure efficient training and scalable deployment without compromising quality. You will be responsible for writing kernels and operations that maximize hardware utilization and minimize latency, requiring deep expertise in GPU optimization, transformer internals, and low-level programming.

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

We are a dedicated research lab focused on building, understanding, using, and risk-managing foundation models. Our mission is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. As part of our team, you will work on the core of cutting-edge foundation model training alongside world-class researchers, data scientists, and engineers. You will tackle fundamental and impactful challenges in AI development, contributing to groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills are essential for establishing our institution as a global hub for high-performance computing in deep learning.

$150k - $450k

Runpod is seeking a Senior ML Systems Engineer focused on Inference to lead efforts in making LLM inference the fastest and most cost-efficient on their platform. This role involves owning LLM serving performance end-to-end, measuring, understanding, and improving it across various models, hardware, and workloads. The work directly impacts customer latency and cost, requiring a hands-on approach to identify and fix bottlenecks, and ensure reliable production deployment. The ideal candidate will be passionate about AI infrastructure and contribute to building the platform for the next generation of AI developers.

$150k - $220k

SambaNova is seeking a talented and driven ML performance engineer to optimize and scale state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform. You will work hands-on with advanced models to push the limits of throughput, latency, and efficiency. This role bridges the gap between deep learning and systems performance, collaborating across compiler, runtime, and hardware layers to deliver world-record performance for large-scale AI inference.

$180k - $255k