LLM Engineer Jobs in Austin

NVIDIA is seeking an AI Compiler Engineer with deep expertise in compiler technologies to join their team. This role focuses on building AI-driven compiler intelligence for production compiler pipelines, aiming to deliver measurable improvements in performance and efficiency. The engineer will advance LLM-enabled workflows for compiler decisioning and developer productivity, working within a diverse and supportive environment that fosters innovation. The position involves collaborating with world-class engineers to shape next-generation compiler capabilities that power large-scale, high-impact products.

$184k - $288k

SambaNova

SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. This role involves bringing frontier open-weight models from Hugging Face to production serving on SambaNova's RDU dataflow accelerators. This includes adapting models, mapping them across chips and hosts, compiling them, and validating them numerically against the reference. You will also build inference features like continuous batching, speculative decoding, and FP8/FP4 as shared modules to reduce the cost of bringing up new models.

$208k - $312k

SambaNova

As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.

$131k - $197k