Senior AI-Native Systems Software Engineer, TensorRT
$152k - $288k • US, CA, Santa Clara
Posted 1d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Categories
AI Agent Engineer
About the job
NVIDIA's TensorRT team is seeking a Senior AI-Native Systems Software Engineer to lead a groundbreaking initiative focused on making TensorRT the global standard for out-of-framework inference. This role involves developing a novel, AI-native framework designed to leverage AI agents for producing high-performance, high-quality C++ software at scale. The ideal candidate is a systems-thinking C++ engineer passionate about advancing agentic development frameworks, staying abreast of deep learning advancements, and enhancing user experience through rapid model onboarding.
Responsibilities
- Architect an AI-native framework to support large numbers of AI agents generating, testing, and validating production-grade software.
- Scale development through agentic workflows using AI-native tools and multi-agent orchestrators.
- Act as a technical scout, identifying and integrating state-of-the-art deep learning breakthroughs into the framework using AI agents.
- Ensure a high-performance path to production for various model families including LLMs, Diffusion, Audio, Vision, and multi-modal models.
- Optimize performance at the intersection of Python orchestration and C++ engine-level operations for latency and throughput gains.
Requirements
- BS, MS, or PhD in Computer Science, Computer Engineering, AI, or equivalent experience.
- 4+ years of relevant software development experience.
- Strong proficiency in modern C++ (C++11/14/17 or newer) and the STL, emphasizing clean, maintainable, and performant code.
- Familiarity with modern inference frameworks and the architectural nuances of LLMs, Diffusion, and multi-modal models.
- Demonstrated systems thinking regarding software architecture for automated, agent-driven development.
- End-to-end product sense, with the ability to translate customer needs into technical requirements and user-centric solutions.
- Pragmatic execution skills, with a track record of delivering production-quality software on tight timelines.
- Excellent communication and collaboration skills.
Benefits
- Equity
- Benefits