AI Infrastructure Engineer Jobs in Austin

NVIDIA Nsight Compute develops groundbreaking performance tools for GPUs, catering to both newcomers and expert CUDA developers. Join our team to craft the future of profiling tools, helping engineers harness the full power of GPU technology for AI and High Performance Computing breakthroughs. You will design and implement innovative features for our GPU performance profiling tools with a focus on AI applications, build tools instantly used by CUDA developers worldwide, and collaborate with internal teams like the compiler and CUDA driver teams to influence and design new features from the bottom up.

$152k - $288k

As a Principal AI Performance Engineer, you will define how Graphcore analyzes and optimizes AI training and inference workloads, shaping decisions across hardware, software, networking, and system architecture. You will lead complex performance investigations, from model behavior to multi-node scaling, translating profiling, benchmarking, and modeling evidence into technical roadmaps and engineering priorities. This role offers rare influence across AI infrastructure at data center scale, guiding strategy, resolving tradeoffs, and raising performance-engineering standards across the organization.

Salary not listed

SambaNova

As a new grad Cloud Platform Engineer, you will write automation and infrastructure code to ensure the SambaNova inference service remains fast and available. This role involves building monitoring and dashboards, managing Kubernetes clusters and Terraform modules, and assisting with the setup of new regions. Upon ramp-up, you will join a shared on-call rotation to support production operations.

$131k - $197k

SambaNova

As a Principal Cloud Platform Engineer, you will specialize in our AI Inferencing Service, acting as the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational challenges. Your primary focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient resource utilization, directly impacting the experience of our customers and the success of our AI products. This role includes participating in a shared on-call rotation to maintain 24/7 service reliability.

$210k - $280k

SambaNova

SambaNova is seeking a Senior Software Engineer to join the ML Infrastructure team. This role is central to our mission as an inference-first company, focusing on designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. You will transform state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud. This position involves end-to-end ownership of systems including request scheduling, advanced decoding algorithms, caching layers, API surfaces, and accuracy infrastructure, and requires close collaboration with ML, compiler, runtime, and product teams.

$200k - $275k