Senior Deep Learning Software Engineer, Inference
$152k - $288k • US, CA, Remote
Posted 7d ago
Job Location
US, CA, Remote
Tech Stack
Remote Work Policy
On-site
Categories
LLM Engineer
About the job
NVIDIA is seeking a Senior Software Engineer to focus on Deep Learning Inference. You will be instrumental in designing, building, and optimizing GPU-accelerated software for advanced AI applications. This role involves developing and maintaining high-performance open-source inference frameworks, crucial for efficient large-scale model serving. You will contribute to improving these platforms to enable smooth deployment of cutting-edge language models and work with the deep learning community to integrate the latest algorithms into inference frameworks. Your efforts will drive performance improvements for state-of-the-art LLM and Generative AI models across various NVIDIA hardware, utilizing open-source tools like CUTLASS, OAI Triton, NCCL, and CUDA kernels.
Responsibilities
- Optimize, analyze, and tune the performance of Deep Learning models in domains such as LLM, Multimodal, and Generative AI.
- Scale the performance of Deep Learning models across different NVIDIA accelerator architectures.
- Contribute features and code to NVIDIA's inference libraries, including vLLM, SGLang, and FlashInfer.
- Collaborate with cross-functional teams on frameworks, NVIDIA libraries, and innovative inference optimization solutions.
Requirements
- Master's or PhD degree or equivalent experience in a relevant field (Computer Engineering, Computer Science, EECS, AI).
- 5+ years of relevant software development experience.
- Excellent C/C++ programming and software design skills.
- Experience with Python is a plus.
- Prior experience with training, deploying, or optimizing Deep Learning model inference in production is a plus.
- Background in performance modeling, profiling, debugging, code optimization, or architectural knowledge of CPU and GPU is a plus.
- GPU programming experience with CUDA, OAI Triton, or CUTLASS is a plus.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity
- Eligibility for benefits