Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles
17d ago
NVIDIA is seeking a Senior Perception Engineer to design and productize the next generation of autonomous driving perception systems. This role focuses on the core 3D obstacle perception pipeline, involving architecture and algorithm design, with a hands-on approach to implementation using modern transformer-based, multi-modal, and vision-language techniques. You will contribute to the development of state-of-the-art deep learning models for obstacle detection and tracking, leveraging multi-camera and multi-sensor fusion. The position requires defining objectives, prototyping architectures, running experiments, and adhering to best practices for training and evaluation, including techniques like large-scale pretraining and parameter-efficient fine-tuning. You will also help define and maintain performance metrics, analyze large datasets to identify failure modes, and contribute to the data strategy for perception, including model-assisted workflows and model-in-the-loop tooling. Collaboration with safety, systems, and software teams is essential to ensure solutions meet product requirements for safety, latency, resource usage, and robustness for large-scale deployment.
$184k - $357k
US, CA, Santa Clara remote PythonLLMFine-Tuning +8 more