1 open role mentioning CUPTI
nvidia
Our LLM Inference Performance Analysis and Optimization team is seeking a Senior Inference Engineer specializing in GPU Kernel Optimization. This role is crucial for maximizing the performance of LLM inference operations by developing advanced infrastructure and tooling. You will build silicon-measured kernel benchmarking systems, model-level performance projection tools, and agentic optimization systems that enhance GPU kernels at the assembly layer. The position involves close collaboration with compiler, kernel, hardware, and framework teams across NVIDIA to identify and address performance bottlenecks, driving measurable improvements in LLM inference.
$184k - $288k