New: upload your resume and get matched to AI jobs. Free to start →

Entry-Level LLM Engineer Jobs

LLM engineers adapt and ship language models: fine-tuning, building evaluation suites, and designing the architecture of LLM applications so they’re accurate, fast and affordable.

Entry-level roles are the junior positions: new graduates, early-career engineers, and software engineers moving into AI. Most ask for strong programming and a project or two that shows you’ve built with models, more than years of experience.

NVIDIA, Clara and CoreWeave have the most open roles here right now. The skills these postings ask for most are C++, Python, PyTorch and Deep Learning.

Open roles
15
Typical salary
$124k - $188k
Median of 4 posted ranges. Salary guide
Newest role
12h ago

Hiring now

Skills these roles ask for

Latest entry-level LLM Engineer roles

GenAI Algorithms Intern – Model Optimization for Inference

12h ago
N

NVIDIA

NVIDIA is seeking a GenAI Algorithms Intern to optimize state-of-the-art generative AI models, including LLMs, VLMs, and diffusion models, for maximum inference efficiency. This role involves designing, implementing, and productionizing model optimization algorithms for deployment on NVIDIA's latest hardware. The focus is on improving ease of use, compute and memory efficiency, and achieving optimal accuracy-performance trade-offs through software-hardware co-design. Your work will span multiple layers of the AI software stack, from algorithm design to integration within NVIDIA's ecosystem and open-source frameworks, with potential for GPU-level optimization including custom kernel development.

$118k - $261k

Poland, Warsaw +1 location onsite Internship
PythonFine-TuningPyTorch +3 more

Software Engineer, Inference AI/ML

1y ago
CoreWeave

CoreWeave

CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.

$92k - $135k

Sunnyvale, CA / Bellevue, WA onsite Full-time
KubernetesPythonGo +10 more

Deep Learning Model and System Optimization Engineering Intern – 2027

8d ago
N

NVIDIA

Our team develops GPU-accelerated software for deep learning inference, focusing on improving the performance, memory efficiency, scalability, and deployment cost of large language models on NVIDIA GPUs. We work across model architectures, algorithms, numerical representations, inference systems, and GPU architectures to achieve these goals. This role will contribute to inference frameworks like TensorRT-LLM, helping to bring state-of-the-art models to production efficiently. We are seeking passionate interns interested in large language model inference, low-precision computing, GPU performance optimization, and hardware-software co-design.

Salary not listed

China, Shanghai onsite Internship
PythonPyTorchDeep Learning +1 more

AI Performance Engineer - New Grad

10d ago
SambaNova

SambaNova

As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.

$131k - $197k

Austin, Texas, United States; San Jose, California, United States onsite Full-time
Meta LlamaPythonPyTorch +8 more

Applied Deep Learning Algorithm Intern, Autonomous Driving - 2027

18d ago
N

NVIDIA

NVIDIA is seeking a highly motivated Applied Deep Learning Algorithm Intern to join its autonomous driving team. This internship offers the opportunity to work with experienced engineers on cutting-edge learning-based driving algorithms. You will contribute to areas such as supervised fine-tuning, reinforcement learning, data optimization, model evaluation, and adapting models for various vehicle lines. This role is ideal for individuals passionate about groundbreaking technologies in AI and autonomous vehicles, looking to gain hands-on experience in a creative and forward-thinking environment.

Salary not listed

China, Shanghai onsite Internship
PythonFine-TuningPyTorch +3 more

AI-Native Engineer, New Grad (Hybrid)

28d ago
C

Clara

Clara is a leading financial technology platform in Latin America, empowering over 50,000 businesses with corporate cards, bill payments, financing, and B2B payment solutions. Recognized as the region's fastest-growing company by the Financial Times in 2025, Clara is dedicated to enhancing business efficiency and regional competitiveness. This role offers an opportunity to start your career at full speed, shipping production code within weeks and owning features end-to-end. You will leverage AI across your workflow, from coding and debugging to research and automation, pushing the boundaries of how your team utilizes AI. The role involves working directly with Product, Design, and senior engineers, and requires a deep understanding of the B2B fintech domain in Latin America.

Salary not listed

Monterrey / NLE / Mexico hybrid Full-time
AWSPythonJava +5 more

Software Engineer Intern - France, Paris

2y ago
D

Dataiku

Dataiku is seeking interns to join their engineering teams, focusing on various aspects of their AI platform. Interns will work on specific features with direct impact on the product, collaborating with senior engineers to code, debug, optimize, and document their work. The role offers exposure to a dynamic technology stack, including Python/Java for backend and Angular/Vue/React for frontend, with opportunities to contribute to areas like AI/ML, MLOps, data preparation, and cloud platform development. Previous intern projects have included improving unsupervised model tooling, building AI-powered coding assistants, enhancing dynamic model management, developing AI-powered code generation, improving search capabilities for data pipelines, contributing to internationalization efforts, creating versatile file processing tools, implementing geospatial transformations, and building full-stack features for cloud engineering.

Salary not listed

France, Paris onsite Internship
KubernetesPythonJava +5 more

GPU Compiler LLVM Backend Intern - 2027

25d ago
N

NVIDIA

NVIDIA is seeking a talented LLVM Compiler Intern to join our GPU Software organization. This role involves working on the construction and emission of high-performance GPU machine instructions for both Graphics and Compute applications. You will be part of a world-class team of compiler engineering experts, contributing to cutting-edge performance and capabilities for NVIDIA's complex parallel SIMT architectures.

Salary not listed

China, Shanghai onsite Internship
Deep LearningC++

Deep Learning Compiler Intern - 2027

1mo ago
N

NVIDIA

NVIDIA is seeking a Deep Learning Compiler Intern for 2027 to join our Architecture group. This role involves contributing to the development of cutting-edge GPU architectures and parallel programming models. You will be immersed in a supportive environment focused on innovation and making a lasting impact on the world through AI and accelerated computing.

Salary not listed

China, Shanghai onsite Internship
C++

AI Computing Software Development Intern - 2027

1mo ago
N

NVIDIA

NVIDIA is seeking skilled interns in artificial intelligence computing solutions to join our AI Compute team in Taiwan. This internship offers the opportunity to work on advanced AI systems, contributing to the development of technologies for Large Language Models, Recommender Systems, and Generative AI, while pushing the limits of GPU performance for AI inference. Interns will focus on specialized tracks within TensorRT-LLM for inference optimization or TensorRT Compiler for graph optimization.

Salary not listed

Taiwan, Taipei +1 location onsite Internship
PythonPyTorchDeep Learning +2 more

AI Computing Development Intern, TensorRT-LLM - 2027

1mo ago
N

NVIDIA

NVIDIA is seeking a TensorRT-LLM Software Development Engineering intern to join its AI Computing team. This role involves contributing to the development of inferencing software that powers deep learning breakthroughs in areas like LLM, ChatGPT, and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused team and possess excellent interpersonal skills.

Salary not listed

China, Shanghai onsite Internship
PyTorchTensorFlowDeep Learning +1 more

AI Computing Software Development Intern, LLM Inference - 2027

1mo ago
N

NVIDIA

NVIDIA is seeking a Software Development Engineer to contribute to the TensorRT LLM and TensorRT Edge LLM projects within its AI Computing team. This role involves developing inferencing software that powers deep learning-based AI advancements, including LLMs and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused environment and possess excellent interpersonal skills.

Salary not listed

China, Shanghai onsite Internship
PyTorchTensorFlowDeep Learning +1 more

AI Engineer Internship – LLM Data

1mo ago
I

Institute of Foundation Models

The Institute of Foundation Models is a research lab focused on building, understanding, using, and managing foundation models. We aim to advance AI research, train future AI leaders, and contribute to a knowledge-driven economy. As an AI Engineer Intern specializing in LLM data, you will work with our team to build and improve high-quality training data for foundation models across pre-training, mid-training, and post-training. You will gain hands-on experience with large-scale data processing, LLM-based data synthesis, data quality evaluation, and model experimentation.

Salary not listed

Abu Dhabi onsite Internship
PythonFine-TuningPyTorch +3 more

Member of Technical Staff, New Grad (BS/MS)

1mo ago
F

Fireworks AI

Fireworks is seeking new graduates for its Member of Technical Staff role, offering a unique opportunity to work on real AI systems in production from day one. As an MTS, you will write and ship code for one of the world's busiest inference platforms, serving hundreds of models at massive scale. The company matches new hires to teams based on their strengths and interests, with potential work spanning inference, model training, distributed systems, cloud infrastructure, developer platforms, or full-stack application engineering. You will be paired with a senior engineer mentor and undergo a structured ramp-up, starting with well-scoped problems and progressing to owning features and systems independently. Fireworks emphasizes a fast-paced environment with a high bar and a commitment to employee development.

$160k - $180k

San Mateo onsite Full-time
KubernetesPythonTypeScript +9 more

AI-Driven 4G PHY SW Engineer

1mo ago
P

Parallel Wireless

Parallel Wireless is seeking a driven PHY SW Engineer to join their R&D team. This role will focus on developing advanced, carrier-grade 4G cellular communication solutions, emphasizing performance, reliability, and AI-driven development. The engineer will contribute to building the software behind next-generation cellular networks and shaping the future of telecommunications through innovative and sustainable solutions.

Salary not listed

Kfar Saba onsite Full-time
KubernetesPythonLLM +6 more

Questions about entry-level LLM Engineer jobs

How many entry-level LLM Engineer jobs are open?
There are 15 open entry-level LLM Engineer jobs on AiRagJobs right now, the newest posted 12h ago. New roles are added every day.
How much do entry-level LLM Engineer jobs pay?
The median posted salary range is $124k–$188k, from 4 jobs here that list pay. That's base salary; equity and bonuses aren't included. See the full salary guide
Which companies are hiring for entry-level LLM Engineer jobs?
NVIDIA, Clara, CoreWeave, Dataiku and Fireworks AI have the most open roles right now.
What skills do entry-level LLM Engineer jobs ask for?
The skills these postings ask for most are C++, Python, PyTorch, Deep Learning and Fine-Tuning. A project that shows you’ve built with them counts for a lot at this level.