Senior Deep Learning Scientist, Multimodal Agentic RL
$184k - $288k • Remote • US, CA, Santa Clara
Posted 17d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
LLM Engineer
About the job
NVIDIA is seeking Senior Deep Learning Scientists to advance our work in streaming and agentic multimodal AI. This role involves developing models capable of reasoning, planning, and acting across diverse modalities, contributing to core algorithmic improvements for multimodal foundation models. You will work on high-impact, large language models and multimodal AI products that enhance user experiences, joining our Nemotron LLM team to tackle real-world agentic AI challenges.
Responsibilities
- Develop, train, fine-tune, and deploy large language models for agentic systems, including audio-visual reasoning, tool usage, and document understanding.
- Advance post-training and alignment methods like instruction tuning, preference optimization, and RLHF/RLVR/MOPD for multimodal agents.
- Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion.
- Lead the collection, development, and benchmarking of multimodal datasets for model evaluation.
- Evaluate model accuracy, safety, and task completion success.
Requirements
- Master's degree or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant experience.
- Excellent Python programming skills with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
- Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
- Foundational understanding of reinforcement learning algorithms and implementation.
- Hands-on experience in post-training multimodal models for omni-modality reasoning, voice chat, and human-AI interaction.
- Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity