OAI Triton Jobs

NVIDIA is seeking a Senior Software Engineer to focus on Deep Learning Inference. You will be instrumental in designing, building, and optimizing GPU-accelerated software for advanced AI applications. This role involves developing and maintaining high-performance open-source inference frameworks, crucial for efficient large-scale model serving. You will contribute to improving these platforms to enable smooth deployment of cutting-edge language models and work with the deep learning community to integrate the latest algorithms into inference frameworks. Your efforts will drive performance improvements for state-of-the-art LLM and Generative AI models across various NVIDIA hardware, utilizing open-source tools like CUTLASS, OAI Triton, NCCL, and CUDA kernels.

$152k - $288k

NVIDIA is seeking a Senior Software Engineer to specialize in Deep Learning Inference. This role involves designing, building, and optimizing GPU-accelerated software for AI applications, focusing on high-performance deep learning frameworks like SGLang and vLLM for efficient large-scale model serving and inference. You will contribute to improving these platforms, enabling the smooth deployment of advanced language models and working with the deep learning community to implement and release the latest algorithms. The work will concentrate on enhancing the performance of state-of-the-art LLM and Generative AI models across various NVIDIA accelerators, utilizing open-source tools and kernels for optimization.

$184k - $357k