TensorRT Jobs
37 open roles mentioning TensorRT
Staff AI Inference and Acceleration Engineer
Figure AI
Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping robots with human-level intelligence. These robots are engineered to perform a variety of tasks in home and commercial markets. We are seeking a Staff AI Inference & Acceleration Engineer to join our Platform Software team. This role will be responsible for the on-board inference architecture for our humanoid robots, acting as the technical authority on how AI workloads are mapped, optimized, and executed across the robot's compute hardware. The primary objective is to reduce power consumption and cost while meeting strict latency and reliability demands for a real-time autonomous system.
$180k - $275k
Software Engineer, Inference AI/ML
CoreWeave
CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.
$92k - $135k
Principal Engineer - Perf and Benchmarking
CoreWeave
CoreWeave is seeking a Principal Engineer to lead its Benchmarking & Performance team. This role will be responsible for a global performance data warehouse, ingesting, storing, transforming, and analyzing performance events across all data centers. You will also play a key part in industry-leading performance benchmarking publications, working closely with NVIDIA and the open-source community to demonstrate CoreWeave's performance and reliability leadership in AI.
$206k - $333k
Senior Systems Performance Engineer
nvidia
NVIDIA is seeking a Senior Validation Engineer to join the DGX Server Product Engineering Team. In this role, you will collaborate with a team of hardware and software engineers to develop and implement sophisticated automated test plans for our leading GPU-accelerated computing products. You will be instrumental in ensuring the performance and reliability of cutting-edge AI hardware by developing and tuning workloads, adapting state-of-the-art AI training and inference frameworks, and applying architectural analysis to characterize workload behavior and identify bottlenecks. This position offers the opportunity to make a significant impact on the future of computing by working on AI-driven technologies.
$136k - $259k
Software Engineer, Perception
Anduril Industries
Anduril Industries is a defense technology company transforming military capabilities with advanced technology. We are seeking Software Engineers specializing in Computer Vision and Machine Learning Engineering to solve challenging perception problems for our UAVs. This role requires hands-on proficiency in C++ and/or Python within a Linux environment, leveraging cutting-edge research and deep expertise in areas like Object Detection and Object Tracking.
$191k - $253k
Senior Software Engineer, Perception
Anduril Industries
Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. We are seeking Senior Software Engineers to join our Tactical Recon & Strike team, which develops aerial small drones and associated equipment. This role will focus on solving complex perception problems for our UAVs, leveraging cutting-edge research in computer vision and machine learning. You will work on bringing products from concept to operational systems, collaborating with specialist teams to address critical customer needs. If you are passionate about creating powerful robotics platforms and tackling challenging technical problems, we encourage you to apply.
$220k - $292k
Senior Computer Vision Engineer
Anduril Industries
Anduril Industries is seeking a Machine Learning Engineer to join the Counter Intrusion MSE team. This role will own the machine learning stack for the team, focusing on designing and training multi-sensor object detection models for edge compute devices and developing learning algorithms to optimize autonomous systems. You will be responsible for the end-to-end design, implementation, and performance of the ML stack, including data collection and training infrastructure. Your work will directly contribute to Anduril's mission of delivering cutting-edge defense technology and will offer opportunities to identify and develop novel ML applications across the product portfolio.
$220k - $292k
Staff TLM, Machine Learning, Sentry Tower
Anduril Industries
We are seeking a Staff ML Tech Lead Manager to apply the latest research to solve our toughest problems. This role will be responsible for owning the entire machine learning stack for the Counter Intrusion team. You will design and train multi-sensor object detection models for perception on edge compute devices that push the boundaries of what's possible with our sensors. You will develop learning algorithms to optimize the behavior of autonomous systems. Your work will directly impact Anduril's ability to deliver cutting-edge defense technology, with the opportunity to identify and develop novel ML applications across our product portfolio.
$220k - $330k
Software Engineer, Training/Inference (C++)
xAI
SpaceXSI is building the high-performance inference platform that serves Grok to millions of users daily with exceptional speed and reliability. As a Member of Technical Staff - Inference, you will be instrumental in designing and optimizing large-scale model serving systems from the ground up. This includes owning distributed infrastructure components like global KV cache, continuous batching, load balancing, and auto-scaling, as well as delving into deep low-level optimizations such as GPU kernels, quantization, and speculative decoding. This is a high-impact role where your contributions will directly influence the speed and reliability of user interactions with Grok at a massive scale.
$180k - $440k
Senior Software Engineer - AI Inference Performance
nvidia
NVIDIA is seeking a Senior Software Engineer to focus on AI Inference Performance, advancing innovative LLM and VLM inference on NVIDIA GPU-accelerated systems. This hands-on role involves pushing workloads to practical performance limits, delivering measurable gains in latency, throughput, efficiency, and scale. You will translate performance models and profiler data into working code, collaborating with various teams and contributing improvements to open-source inference engines. Your work will directly impact production deployments and help shape future NVIDIA platforms.
$184k - $357k
Deep Learning Performance Architect - New College Grad 2027
nvidia
NVIDIA is seeking New College Graduates to join our GPU compute architecture and performance engineering team. This role focuses on pre-silicon modeling, data-supported architecture exploration, and GPU microarchitecture improvement for generative AI workloads, including LLM inference and agentic AI. You will contribute to improving the efficiency and scalability of these models on NVIDIA platforms, gaining hands-on experience with performance modeling, bottleneck analysis, and system-level analysis. This is an opportunity to shape the performance of next-generation AI models in data center and edge environments by developing system-level modeling and correlation solutions.
$124k - $242k
Senior Customer AI Engineer - Token Factory
Nebius
Nebius is a leading cloud infrastructure provider for the global AI economy, building a full-stack AI cloud platform. We are seeking a Senior Customer AI Engineer to join our Token Factory team. This role focuses on helping customers successfully transition their AI workloads from proof-of-concept to production and scale them on Nebius infrastructure. You will operate at the intersection of engineering, delivery, and customer success, ensuring reliable, performant, and cost-efficient deployments. You will collaborate closely with customer engineering teams, Solution Architects, and Product/Infrastructure teams.
Senior Customer AI Engineer - Token Factory
Nebius
Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are looking for a Senior Customer AI Engineer to join our Token Factory team. This role is at the intersection of engineering, delivery, and customer success, ensuring that customer AI workloads transition smoothly from proof-of-concept to production and scale reliably on Nebius infrastructure. You will work closely with customer engineering teams, Solution Architects, and Product/Infrastructure teams to drive stable, performant, and cost-efficient deployments.
$210k - $262k
Senior Machine Learning Engineer, LLM Inference Optimization
Nebius
Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. As a Senior Machine Learning Engineer on the Applied AI team, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization, model compression, speculative decoding, KV-cache optimization, inference engines, and serving architecture to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving model quality and reliability. You will collaborate with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions, validating improvements through reproducible benchmarks and safe production rollouts.
$195k - $262k
Senior Software Engineer - AI System
nvidia
NVIDIA is seeking an experienced software engineer to help build NVIDIA AI for Media SDKs, a GPU-accelerated platform delivering AI-powered video, audio, and augmented reality capabilities for developers building media, content creation, and broadcast workflows. You will develop and optimize AI software across cloud and embedded platforms while advancing the build, validation, and delivery infrastructure behind our SDKs. This role combines strong C++ systems engineering, Linux expertise, accelerated inference, and software delivery automation. You will collaborate with algorithm, platform, infrastructure, and QA teams to deliver efficient, reliable software on NVIDIA hardware.
$184k - $357k
Forward Deployed Engineer, Strategic Inference
Together AI
As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and company growth.
$270k - $300k
Senior ML Infrastructure Engineer
SambaNova
SambaNova is seeking a Senior Software Engineer to join the ML Infrastructure team. This role is central to our mission as an inference-first company, focusing on designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. You will transform state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud. This position involves end-to-end ownership of systems including request scheduling, advanced decoding algorithms, caching layers, API surfaces, and accuracy infrastructure, and requires close collaboration with ML, compiler, runtime, and product teams.
$200k - $275k
Senior Software Engineer, GPU Code Generation for Machine Learning Inference
nvidia
NVIDIA's TensorRT team is seeking talented engineers to advance high-performance AI inference on NVIDIA GPUs. This role focuses on developing software that accelerates state-of-the-art generative AI models for local and enterprise deployments. You will tackle challenging problems in GPU code generation, just-in-time compilation, and inference optimization to deliver high performance across diverse models and hardware configurations. As a Senior Software Engineer, you will design and implement advanced GPU inference software, translating a deep understanding of GPU execution into efficient code generation and measurable improvements in generative AI inference.
$152k - $288k
AI Performance Engineer - New Grad
SambaNova
As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.
$131k - $197k
Engineering Manager, AI Compiler Analysis
nvidia
NVIDIA is seeking an Engineering Manager to lead the strategy for verifying AI compilers for next-generation deep learning workloads. This role involves managing a technical team focused on AI compiler verification, ensuring the quality of AI compilers that optimize deep learning models for GPU execution. The position requires a deep understanding of compiler quality challenges at the intersection of compilers, machine learning frameworks, numerical computing, formal reasoning, and large-scale systems engineering.
$168k - $322k
