TensorRT Jobs

NVIDIA is seeking a Senior Systems Software Engineer to join their Deep Learning Solutions team. This role focuses on optimizing deep learning inference for autonomous vehicles and robotics on edge devices. The ideal candidate will be a hands-on specialist capable of analyzing model architectures at the operator level, identifying performance bottlenecks through kernel trace analysis, and evaluating modern AI architectures on GPU and SOC platforms. This position directly contributes to enhancing real-time perception and response capabilities for autonomous systems, working at the intersection of model frameworks, compiler technology, and embedded hardware. Collaboration with automotive OEMs, robotics teams, and internal hardware groups is a key aspect of this role.

$224k - $357k

NVIDIA Cloud Functions is seeking a motivated AI/ML Engineer with expertise in AI platform engineering at scale. The team develops and manages a serverless deployment platform designed to enable and scale AI inferencing workloads. This platform utilizes globally distributed orchestration of workloads on Kubernetes clusters backed by GPUs, operating in a cloud-agnostic manner. The role involves working with a team of innovative engineers to deliver a top-tier product for both external clients and internal NVIDIA teams, contributing to the forefront of cloud engineering paradigms for AI at scale.

$152k - $288k

Luma is seeking a Software Engineer to own the serving of their AI models. This role involves integrating new model architectures into the inference engine, scaling deployments across thousands of machines, and optimizing the utilization of expensive GPU fleets while meeting internal service level objectives (SLOs). The work focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and ensuring reliability across diverse clusters and hardware providers. This position is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale, rather than those seeking pure modeling work.

Luma is seeking a Software Engineer to own the serving of their AI models. This role involves integrating new model architectures into the inference engine, scaling deployments across thousands of machines, and optimizing the utilization of expensive GPU fleets while meeting internal service level objectives (SLOs). The work focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and ensuring reliability across diverse clusters and hardware providers. This position is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale, rather than those seeking pure modeling work.

$195k - $345k

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

Baseten is seeking an Engineering Manager to lead a portion of their Inference Performance team. This team is responsible for accelerating and optimizing the performance of demanding AI workloads on GPUs. The role involves managing and growing a team of inference performance engineers focused on the inference engine and runtime, including areas like kernels, scheduling, batching, KV-cache management, and speculative decoding. It's a hands-on technical leadership position where you will define the team's direction, solve complex problems, and contribute technically to GPU performance while also focusing on hiring, developing, and supporting your team members. Your team's work will directly impact customer model inference speed and serving efficiency, and you will play a key role in shaping the team's structure as it scales.

$240k - $270k

Code Metal is seeking a Staff AI Platform Engineer to architect and build the foundational AI enablement stack that internal engineering teams rely on. This role involves designing and operating production systems for GPU inference serving, model gateways, agent harnesses, context management, and observability. While primarily an engineering role focused on building and operating production systems, it also requires solid data science and AI research fundamentals to work closely with the AI Research team and conduct experiments when necessary. The platform is built to product standards, ensuring reliability and scalability for AI-driven code transpilation, modernization, optimization, modeling, and simulation solutions.

$205k - $250k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking inference performance engineers to make demanding AI workloads run faster and more efficiently. You will work across the entire stack, from the inference engine and runtime through scheduling, serving, and routing, applying advanced techniques to optimize performance. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to LLM inference.

$180k - $360k

At Mach9, ML Engineers build the perception models at the core of our AI-enabled CAD system, extracting 3D object and line features from dense LiDAR point clouds and imagery. This product-focused role involves working closely with customers to develop Computer Vision/Machine Learning pipelines and workflows that solve their problems. You will be responsible for shipping new features and product lines end-to-end, from data strategy and model training to evaluation. This position is ideal for early-career engineers who learn quickly, are curious, and find satisfaction in shipping impactful products.

$180k - $300k

Artificial intelligence is shifting from passive help to autonomous, always-on workflows. Our mission is to make this change seamless, efficient, and secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will guide development so open-source AI agents operate locally, safely, and efficiently on consumer PCs. By combining powerful local inference with strong privacy routers and sandboxed execution, you will help develop the foundation of the desktop AI operating system.

$184k - $357k

NVIDIA is seeking a Senior Software Engineer to lead the bring-up, triage, benchmarking, analysis, and optimization of distributed training and inference workloads across NVIDIA GPU platforms at the largest scales. In this role, you will set technical direction for communication libraries, model frameworks, and inference/training stacks to ensure state-of-the-art LLM workloads run efficiently and reliably at scale. You will lead deep performance and reliability investigations on multi-GPU and multi-node deployments, define how new platforms are benchmarked and qualified, and build the resilience and failure-attribution capabilities essential for large clusters. This is a hands-on, senior individual-contributor role for an engineer experienced at the intersection of deep learning systems, GPU performance, distributed computing, and large-scale operations.

$184k - $357k

Together AI

Together AI's Model Shaping team focuses on tailoring open foundation models for downstream applications, building services that help ML developers select and improve models with domain-specific data. The team also develops efficient model training and evaluation methods, drawing from machine learning, NLP, and ML systems. As a Research Engineer, you will develop a platform for users to customize open-source models with their own data, working across training and inference stacks. You will build and enhance services for Fine-Tuning, Reinforcement Learning, and Evaluation, ensuring a smooth transition from post-training to production serving and optimizing inference engines for RL training. Collaboration with product, research, and engineering teams is key to maintaining API reliability and performance, ultimately contributing to the foundational layer of the open-source AI ecosystem.

$200k - $290k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Senior ML Engineer to lead the model serving layer for voice workloads. You will optimize inference engines like TRT-LLM and SGLang to serve models such as Whisper, Parakeet, Orpheus, and Kokoro, focusing on pushing latency and throughput boundaries. This role involves profiling GPU utilization, designing batching strategies for streaming audio, and accelerating the transition of new model architectures from research to production. As a foundational hire on a small, high-impact team, you will address the unique challenges of voice inference, including streaming audio, real-time latency, and tokenization, shaping how Together serves voice models as the industry moves towards end-to-end speech-to-speech systems.

$200k - $260k

NVIDIA is seeking a Senior Integration Engineer to join their autonomous driving team. This role focuses on accelerating the development, integration, evaluation, and deployment of end-to-end driving models. You will collaborate across model development, data, simulation, systems software, and vehicle engineering teams to transform evolving AI models into reliable autonomous driving functionality on NVIDIA's computing platforms. The position involves working with large-scale training infrastructure, simulation environments, and production vehicle platforms.

$152k - $288k

Parallel Wireless is seeking experienced wireless algorithm experts to research and design advanced cellular communication algorithms for 5G and beyond products. This role will leverage neural networks and machine learning techniques to reimagine mobile networks with innovative, energy-efficient Open RAN solutions. The ideal candidate will contribute to the future of telecommunications by driving innovation through green and sustainable networks.

NVIDIA AI for Media is seeking outstanding engineers to join its team, focusing on building and optimizing real-time AI solutions for media and entertainment workflows. This role will involve setting the technical direction for content authenticity AI, architecting model and pipeline strategies for detecting synthetic and manipulated media, and making critical build-vs-adapt decisions. The team works on core technologies to solve ambitious computer vision and deep learning problems, aiming to deliver studio-quality audio and high-resolution video enhancement and effects.

$272k - $431k

Moveworks is seeking a Machine Learning Engineer to develop cutting-edge ML infrastructure for building and serving LLMs. This role is pivotal in constructing, optimizing, and scaling end-to-end machine learning systems, encompassing distributed training and inference pipelines for large language models, model evaluation and monitoring frameworks, and LLM latency optimization. The frameworks developed will serve as a robust foundation for hundreds of ML and NLP models in production, impacting millions of enterprise employees. You will address challenges in service scalability and core algorithm optimization, working closely with machine learning, data infrastructure, and core skill teams. Your contributions will significantly influence customer AI experiences and the long-term scalability of our core AI product.