AI Engineering Jobs in Austin

Join the GPU Foundations Developer Tools team at NVIDIA and contribute to the development of groundbreaking performance analysis tools for GPUs and SoCs. You will innovate as you develop performance analysis capabilities for NVIDIA hardware, drivers, and SDKs, supporting current and future generations of GPUs. Your work will empower inventors worldwide to maximize the potential of our GPU hardware in their applications, directly impacting the performance profiling tools based on next-generation hardware that you help define.

$152k - $288k

NVIDIA is seeking an AI Compiler Engineer with deep expertise in compiler technologies to join their team. This role focuses on building AI-driven compiler intelligence for production compiler pipelines, aiming to deliver measurable improvements in performance and efficiency. The engineer will advance LLM-enabled workflows for compiler decisioning and developer productivity, working within a diverse and supportive environment that fosters innovation. The position involves collaborating with world-class engineers to shape next-generation compiler capabilities that power large-scale, high-impact products.

$184k - $288k

NVIDIA is seeking an AI Systems Software Engineering Intern to contribute to compilers and developer tools by applying AI agents, machine learning, and performance engineering. Interns will collaborate with compiler and AI engineers on projects involving code, compiler feedback, performance experiments, and optimization. The role offers opportunities to focus on agentic workflows, learned models, performance analysis, or AI-enabled developer tools, depending on the intern's background and interests. Experience in all areas is not required.

$0k - $0k

NVIDIA Nsight Compute develops groundbreaking performance tools for GPUs, catering to both newcomers and expert CUDA developers. Join our team to craft the future of profiling tools, helping engineers harness the full power of GPU technology for AI and High Performance Computing breakthroughs. You will design and implement innovative features for our GPU performance profiling tools with a focus on AI applications, build tools instantly used by CUDA developers worldwide, and collaborate with internal teams like the compiler and CUDA driver teams to influence and design new features from the bottom up.

$152k - $288k

NVIDIA is seeking a Backend Compiler Engineer to join our GPU Software organization. The Compiler team is responsible for constructing and emitting high-performance GPU machine instructions for Graphics (OpenGL, Vulkan, DX) and Compute (CUDA, PTX, OpenCL, Fortran, C++). This team comprises leading compiler engineering experts who deliver cutting-edge performance and capabilities for NVIDIA's complex parallel SIMT architectures.

$152k - $242k

SambaNova

SambaNova is seeking a Principal Place and Route (PnR) Engineer to join our team. This role involves developing and tuning the software that maps dataflow graphs onto SambaNova's Reconfigurable Dataflow Unit (RDU). You will work on partitioning, placement, and routing algorithms to optimize the mapping of customer workloads, including large language model inference and training, onto our hardware. Your contributions will directly impact the throughput and performance of compiled programs and will be integrated into production releases.

$0k - $1000k

SambaNova

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. This role involves bringing frontier open-weight models from Hugging Face to production serving on SambaNova's RDU dataflow accelerators. This includes adapting models, mapping them across chips and hosts, compiling them, and validating them numerically against the reference. You will also build inference features like continuous batching, speculative decoding, and FP8/FP4 as shared modules to reduce the cost of bringing up new models.

$208k - $312k

SambaNova

SambaNova is seeking a new grad ML Infrastructure Engineer to join their team. This role involves writing production Python code for the inference serving stack, including vLLM integration and public APIs. You will contribute to bringing features like speculative decoding, prompt caching, and tool calling into production on the RDU, and develop accuracy and regression tests to ensure quality before customer release.

$131k - $197k

SambaNova

As a new grad Cloud Platform Engineer, you will write automation and infrastructure code to ensure the SambaNova inference service remains fast and available. This role involves building monitoring and dashboards, managing Kubernetes clusters and Terraform modules, and assisting with the setup of new regions. Upon ramp-up, you will join a shared on-call rotation to support production operations.

$131k - $197k

SambaNova

As a Principal Cloud Platform Engineer, you will specialize in our AI Inferencing Service, acting as the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational challenges. Your primary focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient resource utilization, directly impacting the experience of our customers and the success of our AI products. This role includes participating in a shared on-call rotation to maintain 24/7 service reliability.

$210k - $280k

SambaNova

SambaNova is seeking a new grad Compiler Engineer to work on core areas of our compiler, which powers the RDU (Reconfigurable Dataflow Unit) chip. This role involves working on the compiler's IR and pass infrastructure, model lowering and partitioning, tensor tiling, memory management, and mapping operations onto the accelerator fabric. You will gain insight into how compiler decisions impact chip performance, write production code in C++ and Python, perform low-level debugging, and collaborate with runtime and hardware teams. Senior engineers will provide code reviews and mentorship.

$131k - $197k

SambaNova

SambaNova is seeking a Senior Software Engineer to join the ML Infrastructure team. This role is central to our mission as an inference-first company, focusing on designing, building, and operating the production-grade inference infrastructure that powers SambaNova's serving stack on our Reconfigurable Dataflow Unit (RDU) architecture. You will transform state-of-the-art inference techniques into reliable, high-throughput, low-latency services exposed to customers through SambaStack and SambaCloud. This position involves end-to-end ownership of systems including request scheduling, advanced decoding algorithms, caching layers, API surfaces, and accuracy infrastructure, and requires close collaboration with ML, compiler, runtime, and product teams.

$200k - $275k

SambaNova

As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.

$131k - $197k

Tenstorrent is seeking a CPU Cluster Performance Architect to influence the performance and scalability of their next-generation CPUs. This role focuses on the intricate interactions between multiple CPU cores within a cluster, including cache hierarchies, coherent interconnects, memory bandwidth, and overall system behavior. It's a hands-on architecture position that leverages performance models and simulation to identify bottlenecks, evaluate design tradeoffs, and guide architectural decisions early in the development cycle. The architect will collaborate closely with CPU architects, RTL designers, software and compiler teams, and system architects to understand workload characteristics and translate performance insights into tangible architectural enhancements. This is a remote position based in North America, and the company welcomes candidates at various experience levels.

$100k - $500k

Tenstorrent is a leader in AI technology, aiming to revolutionize performance, usability, and cost-efficiency. As AI redefines computing, our solutions must integrate innovations across software models, compilers, platforms, networking, and semiconductors. We are seeking a CPU Performance Modeling Architect to evaluate, shape, and optimize future CPU architectures. This role involves using performance modeling, workload analysis, and a deep understanding of CPU architecture to address complex design questions. You will collaborate closely with CPU architects, RTL designers, software and compiler teams, and system engineers to identify performance opportunities, assess architectural trade-offs, and translate modeling insights into actionable design decisions.

$100k - $500k

Tenstorrent is seeking a Physical Design Engineer to lead cross-functional efforts in solving complex physical design challenges and developing end-to-end RTL-to-GDS methodologies across advanced nodes, with a strong focus on PPA and runtime improvements. The engineer will architect, integrate, and deploy AI/ML-driven solutions into production physical design flows, creating custom CAD tools and partnering with internal teams and EDA vendors to drive next-generation, ML-enabled capabilities. This role is hybrid, based out of Santa Clara, CA or Austin, TX or Fort Collins, CO. We welcome candidates at various experience levels for this role, and offers will align with the assessed level.

$100k - $500k