Senior System Software Engineer, Agentic Retrieval
$184k - $357k • Remote • US, CA, Santa Clara
Posted 17d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Engineer
About the job
NVIDIA is seeking a System Software Engineer specializing in Agentic Retrieval to join our team at the forefront of the AI revolution. You will develop pipelines for indexing and querying multi-modal content, working with Generative AI, LLM, VLLM, and Agentic Retrieval technologies on our innovative hardware and software platforms. This role is crucial for accelerating containerized pipelines for high-quality multi-modal datasets and enhancing retrieval efficacy. You will focus on developing efficient, scalable systems for data processing, deduplication, filtering, and classification for tailored models, with an emphasis on iterative testing and improvement in system cost, speed, and accuracy through micro-optimization, prompt engineering, fine-tuning, and applying new research.
Responsibilities
- Develop and optimize Rust-based data processing frameworks for large datasets on GPU-accelerated environments.
- Lead development and iterative optimization of components for Agentic Retrieval pipelines, ensuring GPU acceleration and optimal model performance.
- Collaborate with LLM & ML researchers to develop full-stack, GPU-accelerated data preparation pipelines for multimodal models.
- Implement benchmarking, profiling, and optimization of innovative algorithms in Python for LLM applications.
- Build and evaluate Proofs of Concept (POCs) and develop roadmaps for production-level tools and library features within the LLM ecosystem.
- Develop integrated systems for unified user experiences across applications.
- Build and maintain Continuous Delivery pipelines to accelerate and secure production changes.
- Provide peer reviews on performance, scalability, and correctness, and contribute to the adoption of new technologies and standards.
Requirements
- Bachelor’s or Master’s Degree in Computer Science, Computer Engineering, or a related field (or equivalent experience).
- 6+ years of experience in a similar or related role.
- Experience delivering software in a cloud context and managing cloud infrastructure.
- Knowledge of MLOps technologies such as Docker-Compose, Containers, and Kubernetes.
- In-depth hands-on understanding of NLP, LLM, VLM, Generative AI, and Agentic Retrieval workflows.
- Self-starter with a passion for continuous learning and knowledge sharing.
- Excellent communication skills for distilling complex topics.
- Ability to work successfully with multi-functional teams and coordinate across organizational boundaries.
Benefits
- Equity
- Benefits