Senior Deep Learning Software Engineer, Inference
$184k - $357k • US, CA, Santa Clara
Posted 1mo ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
NVIDIA is seeking a Senior Software Engineer to specialize in Deep Learning Inference. This role involves designing, building, and optimizing GPU-accelerated software for AI applications, focusing on high-performance deep learning frameworks like SGLang and vLLM for efficient large-scale model serving and inference. You will contribute to improving these platforms, enabling the smooth deployment of advanced language models and working with the deep learning community to implement and release the latest algorithms. The work will concentrate on enhancing the performance of state-of-the-art LLM and Generative AI models across various NVIDIA accelerators, utilizing open-source tools and kernels for optimization.
Responsibilities
- Optimize, analyze, and tune deep learning models for LLM, Multimodal, and Generative AI.
- Scale deep learning model performance across different NVIDIA accelerator architectures.
- Contribute features and code to NVIDIA's inference libraries (vLLM, SGLang, FlashInfer) and LLM software solutions.
- Collaborate with cross-functional teams on frameworks, NVIDIA libraries, and inference optimization.
Requirements
- Master's or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, or AI.
- 6+ years of relevant software development experience.
- Excellent C/C++ programming and software design skills.
- Experience with training, deploying, or optimizing deep learning model inference in production is a plus.
- Background in performance modeling, profiling, debugging, code optimization, or CPU/GPU architectural knowledge is a plus.
- Python experience is a plus.
Benefits
- Equity
- Benefits