Senior Research Engineer - Enterprise Products
$192k - $357k • Remote • US, WA, Remote
Posted 1d ago
Job Location
US, WA, Remote
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Research Engineer
About the job
NVIDIA is seeking a Senior Research Engineer passionate about Generative AI inference to help revolutionize how AI is integrated into products and services. Our team is at the forefront of developing optimized inferencing technologies for a wide range of generative AI models, from language to images. We are involved in the entire machine learning lifecycle, from initial concepts and applied research to engineering for optimized inference and final deployment. This role involves close collaboration with research teams, engineers, and the open-source community.
Responsibilities
- Design and evaluate routing policies for LLM traffic to optimize the use of model systems.
- Build and execute agentic benchmarks to measure algorithm quality and generate calibration data and routing profiles.
- Contribute to an open-source repository by creating design documents, participating in code reviews, writing documentation, and engaging with the community.
- Collaborate with engineering teams across NVIDIA to ensure seamless integration of software within the NVIDIA accelerated serving stack.
Requirements
- Bachelor's or Master's degree in Computer Science or equivalent experience.
- 8+ years of industry experience with Deep Learning frameworks like PyTorch or TensorFlow.
- Experience designing or running LLM evaluations/benchmarks, preferably agentic ones, and deriving statistically sound conclusions.
- Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
- An empirical research mindset, including forming hypotheses, running calibrations, and iterating on results.
- Strong communication and interpersonal skills, with the ability to thrive in a dynamic, distributed team.
- Strong computer science fundamentals in algorithms, data structures, computational complexity, parallel and distributed computing, and system software.
Benefits
- Equity
- Benefits