Senior System Software Engineer - Dynamo-Triton Inference Server
$152k - $288k • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
LLM Engineer
About the job
We are seeking a Senior System Software Engineer to contribute to the development of the Dynamo-Triton Inference Server. This role is part of NVIDIA's GPU-accelerated deep learning software team, which is building a high-performance AI inference platform to simplify the design and deployment of AI models. The platform aims to make AI models more accessible to all users and is crucial for enabling breakthroughs in various AI fields, including image classification, speech recognition, and natural language processing.
Responsibilities
- Develop world-class GPU-accelerated AI inference serving software.
- Contribute to feature development and drive customer adoption.
- Unify Triton Inference Server and NVIDIA Dynamo stacks into a high-performance inference platform serving both LLM and non-LLM workloads.
- Actively participate in the open-source deep learning software engineering community.
- Build robust software for production server or cloud environments, optimizing prediction throughput and latency, and adopting next-generation inference technologies.
Requirements
- MS or PhD in Computer Science or equivalent experience.
- 5+ years of professional experience in deep learning software.
- Excellent Rust & C++ skills, familiarity with Python.
- Strong programming, software design, debugging, performance analysis, and test design skills.
- Experience with high-scale distributed systems and ML systems.
- Strong communication skills and ability to work in a fast-paced, agile team environment.
Benefits
- Equity
- Benefits