New: upload your resume and get matched to AI jobs. Free to start →

Senior Vision Language Model Engineer

$184k - $357k • US, CA, Santa Clara • Full-time

Posted 17d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Engineer

About the job

NVIDIA is seeking a senior vision language model engineer to design and build agentic data and training workflows for Autonomous Vehicles, Robotics, and Medical applications. The role involves developing and evaluating prototypes of the latest models, such as VLMs and VLAs, for video search and understanding, and enabling advances in autonomous driving, healthcare, and robotics. The engineer will also design and implement agentic data workflows to automate data discovery, labeling, evaluation, and retraining, and build, curate, and maintain high-quality multimodal datasets tailored for physical AI problems. This work will redefine dataset search and model training capabilities within NVIDIA's product offerings and impact leading companies in Physical AI.

Responsibilities

  • Develop and evaluate prototypes of VLMs and VLAs for video search and understanding.
  • Design and implement agentic data workflows for automation of data discovery, labeling, evaluation, and retraining.
  • Build, curate, and maintain multimodal datasets (video, sensor, language/action traces) for physical AI problems.
  • Explore and productize new data sources, including simulation and synthetic data.
  • Utilize agentic AI workflows across the applied research lifecycle.
  • Collaborate with research, model development, performance, and product teams.
  • Contribute to NVIDIA Cosmos Dataset Search and other core NVIDIA platforms.

Requirements

  • PhD with 4+ years, MS with 6+ years, or BS with 8+ years of relevant experience in Computer Science, Computer Engineering, or related technical field.
  • Strong background in modern deep learning, including transformer-based architectures, video modeling, and multimodal VLM/VLA or foundation models.
  • Experience training and deploying deep learning models on real-world datasets, including data preprocessing, distributed training, evaluation, debugging, and iterative improvement.
  • Proficiency in Python and at least one deep learning framework.
  • Knowledge of the latest research in image and video search for autonomous vehicles, healthcare, robotics, or related physical AI applications.
  • Familiarity with agentic AI workflows across the applied research lifecycle, including prototyping, benchmarking, and integrating prototypes into production codebases.
  • Clear and effective communication skills, with experience working in dynamic, product- and research-focused teams.

Benefits

  • Equity
  • Generous benefits package
  • Competitive salaries