Entry-Level LLM Engineer Jobs
LLM engineers adapt and ship language models: fine-tuning, building evaluation suites, and designing the architecture of LLM applications so they’re accurate, fast and affordable.
Entry-level roles are the junior positions: new graduates, early-career engineers, and software engineers moving into AI. Most ask for strong programming and a project or two that shows you’ve built with models, more than years of experience.
NVIDIA, Clara and CoreWeave have the most open roles here right now. The skills these postings ask for most are C++, Python, PyTorch and Deep Learning.
- Open roles
- 15
- Newest role
- 12h ago
Hiring now
Skills these roles ask for
Latest entry-level LLM Engineer roles
GenAI Algorithms Intern – Model Optimization for Inference
NVIDIA
NVIDIA is seeking a GenAI Algorithms Intern to optimize state-of-the-art generative AI models, including LLMs, VLMs, and diffusion models, for maximum inference efficiency. This role involves designing, implementing, and productionizing model optimization algorithms for deployment on NVIDIA's latest hardware. The focus is on improving ease of use, compute and memory efficiency, and achieving optimal accuracy-performance trade-offs through software-hardware co-design. Your work will span multiple layers of the AI software stack, from algorithm design to integration within NVIDIA's ecosystem and open-source frameworks, with potential for GPU-level optimization including custom kernel development.
$118k - $261k
Software Engineer, Inference AI/ML
CoreWeave
CoreWeave is seeking a Software Engineer to join the Inference team, focusing on shipping production features that enhance model serving on their GPU platform. This role involves improving latency, reliability, and cost-efficiency. As an IC1, you will implement well-scoped changes, learn operational practices, and grow with mentorship from experienced engineers. CoreWeave is the essential cloud for AI, providing a platform of technology, tools, and teams that enable innovators to build and scale AI with confidence.
$92k - $135k
Deep Learning Model and System Optimization Engineering Intern – 2027
NVIDIA
Our team develops GPU-accelerated software for deep learning inference, focusing on improving the performance, memory efficiency, scalability, and deployment cost of large language models on NVIDIA GPUs. We work across model architectures, algorithms, numerical representations, inference systems, and GPU architectures to achieve these goals. This role will contribute to inference frameworks like TensorRT-LLM, helping to bring state-of-the-art models to production efficiently. We are seeking passionate interns interested in large language model inference, low-precision computing, GPU performance optimization, and hardware-software co-design.
Salary not listed
AI Performance Engineer - New Grad
SambaNova
As a new grad AI Performance Engineer, you will be responsible for bringing up new open-source foundation models on the SambaNova dataflow platform and optimizing their performance. This involves profiling model execution, identifying performance bottlenecks across compiler, runtime, and hardware layers, and applying optimizations such as quantization, kernel fusion, and improved scheduling. You will collaborate with machine learning, compiler, runtime, and hardware teams to integrate performance improvements into SambaNova products and benchmark throughput and latency to track changes across releases.
$131k - $197k
Applied Deep Learning Algorithm Intern, Autonomous Driving - 2027
NVIDIA
NVIDIA is seeking a highly motivated Applied Deep Learning Algorithm Intern to join its autonomous driving team. This internship offers the opportunity to work with experienced engineers on cutting-edge learning-based driving algorithms. You will contribute to areas such as supervised fine-tuning, reinforcement learning, data optimization, model evaluation, and adapting models for various vehicle lines. This role is ideal for individuals passionate about groundbreaking technologies in AI and autonomous vehicles, looking to gain hands-on experience in a creative and forward-thinking environment.
Salary not listed
AI-Native Engineer, New Grad (Hybrid)
Clara
Clara is a leading financial technology platform in Latin America, empowering over 50,000 businesses with corporate cards, bill payments, financing, and B2B payment solutions. Recognized as the region's fastest-growing company by the Financial Times in 2025, Clara is dedicated to enhancing business efficiency and regional competitiveness. This role offers an opportunity to start your career at full speed, shipping production code within weeks and owning features end-to-end. You will leverage AI across your workflow, from coding and debugging to research and automation, pushing the boundaries of how your team utilizes AI. The role involves working directly with Product, Design, and senior engineers, and requires a deep understanding of the B2B fintech domain in Latin America.
Salary not listed
Software Engineer Intern - France, Paris
Dataiku
Dataiku is seeking interns to join their engineering teams, focusing on various aspects of their AI platform. Interns will work on specific features with direct impact on the product, collaborating with senior engineers to code, debug, optimize, and document their work. The role offers exposure to a dynamic technology stack, including Python/Java for backend and Angular/Vue/React for frontend, with opportunities to contribute to areas like AI/ML, MLOps, data preparation, and cloud platform development. Previous intern projects have included improving unsupervised model tooling, building AI-powered coding assistants, enhancing dynamic model management, developing AI-powered code generation, improving search capabilities for data pipelines, contributing to internationalization efforts, creating versatile file processing tools, implementing geospatial transformations, and building full-stack features for cloud engineering.
Salary not listed
GPU Compiler LLVM Backend Intern - 2027
NVIDIA
NVIDIA is seeking a talented LLVM Compiler Intern to join our GPU Software organization. This role involves working on the construction and emission of high-performance GPU machine instructions for both Graphics and Compute applications. You will be part of a world-class team of compiler engineering experts, contributing to cutting-edge performance and capabilities for NVIDIA's complex parallel SIMT architectures.
Salary not listed
Deep Learning Compiler Intern - 2027
NVIDIA
NVIDIA is seeking a Deep Learning Compiler Intern for 2027 to join our Architecture group. This role involves contributing to the development of cutting-edge GPU architectures and parallel programming models. You will be immersed in a supportive environment focused on innovation and making a lasting impact on the world through AI and accelerated computing.
Salary not listed
AI Computing Software Development Intern - 2027
NVIDIA
NVIDIA is seeking skilled interns in artificial intelligence computing solutions to join our AI Compute team in Taiwan. This internship offers the opportunity to work on advanced AI systems, contributing to the development of technologies for Large Language Models, Recommender Systems, and Generative AI, while pushing the limits of GPU performance for AI inference. Interns will focus on specialized tracks within TensorRT-LLM for inference optimization or TensorRT Compiler for graph optimization.
Salary not listed
AI Computing Development Intern, TensorRT-LLM - 2027
NVIDIA
NVIDIA is seeking a TensorRT-LLM Software Development Engineering intern to join its AI Computing team. This role involves contributing to the development of inferencing software that powers deep learning breakthroughs in areas like LLM, ChatGPT, and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused team and possess excellent interpersonal skills.
Salary not listed
AI Computing Software Development Intern, LLM Inference - 2027
NVIDIA
NVIDIA is seeking a Software Development Engineer to contribute to the TensorRT LLM and TensorRT Edge LLM projects within its AI Computing team. This role involves developing inferencing software that powers deep learning-based AI advancements, including LLMs and Generative AI. The ideal candidate will work in a fast-paced, delivery-focused environment and possess excellent interpersonal skills.
Salary not listed
AI Engineer Internship – LLM Data
Institute of Foundation Models
The Institute of Foundation Models is a research lab focused on building, understanding, using, and managing foundation models. We aim to advance AI research, train future AI leaders, and contribute to a knowledge-driven economy. As an AI Engineer Intern specializing in LLM data, you will work with our team to build and improve high-quality training data for foundation models across pre-training, mid-training, and post-training. You will gain hands-on experience with large-scale data processing, LLM-based data synthesis, data quality evaluation, and model experimentation.
Salary not listed
Member of Technical Staff, New Grad (BS/MS)
Fireworks AI
Fireworks is seeking new graduates for its Member of Technical Staff role, offering a unique opportunity to work on real AI systems in production from day one. As an MTS, you will write and ship code for one of the world's busiest inference platforms, serving hundreds of models at massive scale. The company matches new hires to teams based on their strengths and interests, with potential work spanning inference, model training, distributed systems, cloud infrastructure, developer platforms, or full-stack application engineering. You will be paired with a senior engineer mentor and undergo a structured ramp-up, starting with well-scoped problems and progressing to owning features and systems independently. Fireworks emphasizes a fast-paced environment with a high bar and a commitment to employee development.
$160k - $180k
AI-Driven 4G PHY SW Engineer
Parallel Wireless
Parallel Wireless is seeking a driven PHY SW Engineer to join their R&D team. This role will focus on developing advanced, carrier-grade 4G cellular communication solutions, emphasizing performance, reliability, and AI-driven development. The engineer will contribute to building the software behind next-generation cellular networks and shaping the future of telecommunications through innovative and sustainable solutions.
Salary not listed
Questions about entry-level LLM Engineer jobs
- How many entry-level LLM Engineer jobs are open?
- There are 15 open entry-level LLM Engineer jobs on AiRagJobs right now, the newest posted 12h ago. New roles are added every day.
- How much do entry-level LLM Engineer jobs pay?
- The median posted salary range is $124k–$188k, from 4 jobs here that list pay. That's base salary; equity and bonuses aren't included. See the full salary guide
- Which companies are hiring for entry-level LLM Engineer jobs?
- NVIDIA, Clara, CoreWeave, Dataiku and Fireworks AI have the most open roles right now.
- What skills do entry-level LLM Engineer jobs ask for?
- The skills these postings ask for most are C++, Python, PyTorch, Deep Learning and Fine-Tuning. A project that shows you’ve built with them counts for a lot at this level.
