New: upload your resume and get matched to AI jobs. Free to start →

LLM Engineer Jobs at Startups

LLM engineers adapt and ship language models: fine-tuning, building evaluation suites, and designing the architecture of LLM applications so they’re accurate, fast and affordable.

These roles are at early-stage startups, from seed to Series B. Teams are small, so engineers own more of the product, ship faster and often get meaningful equity, in return for less structure and more risk than at a large company.

Handshake AI, Together AI and xAI have the most open roles here right now. Of these, 18% can be done remotely. The skills these postings ask for most are Python, LLM, Reinforcement Learning and PyTorch.

Open roles
28
Typical salary
$204k - $300k
Median of 12 posted ranges. Salary guide
Newest role
1d ago

Hiring now

Skills these roles ask for

Latest startup LLM Engineer roles

Model Engineer, Post-Training & RL

6mo ago
x

xAI

SpaceX is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role focuses on the most critical post-training and reinforcement learning challenges, including reward modeling, preference optimization (RLHF/DPO), and RL for improving reasoning, truthfulness, and real-world capabilities. You will work on cutting-edge AI problems with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

$180k - $600k

Palo Alto, CA onsite
LLMReinforcement LearningRLHF

Human Data Engineer

2mo ago
x

xAI

SpaceXSI is building Super Intelligence to help humanity understand the universe, developing the full Super Intelligence stack from supercomputers to large language models and applications. This role is at the intersection of engineering and data operations, focusing on ensuring engineering teams receive high-quality data for training and evaluation. You will partner with model teams, design projects to capture meaningful signals, and drive data yield and evaluation lift, influencing data strategy through hands-on technical work.

$144k - $220k

Palo Alto, CA onsite
PythonLLMSQL +2 more

Research Engineer / Scientist, Reinforcement Learning

1d ago
H

Harvey.ai

Harvey is transforming legal and professional services by combining advanced agentic AI, an enterprise platform, and deep domain expertise. This role offers a unique opportunity to contribute to a rapidly scaling company at a pivotal moment, defining a new category in real-time. The team operates with intensity, ownership, and a commitment to excellence, driven by values of decisiveness, simplicity, and continuous improvement. If you are motivated to do your best work alongside driven individuals, Harvey is the place to build the future of professional services.

$230k - $340k

New York +3 locations onsite Full-time
PythonLLMFine-Tuning +4 more

Senior / Staff Software Engineer — Product (Backend-Focused)

1d ago
Snorkel AI

Snorkel AI

Snorkel AI is seeking Senior and Staff Product Engineers with strong backend experience to help shape and deliver product capabilities that simplify complex workflows for users. This role involves owning backend features from concept to production, collaborating closely with Product, Design, and Engineering teams. You will be instrumental in building and evolving APIs, services, data models, and workflow capabilities that support the product, focusing on areas like data cataloging, agent benchmarking, and workflow automation. The ideal candidate possesses sound technical judgment and a commitment to product quality, usability, and impact.

$208k - $315k

San Francisco, CA (Hybrid) hybrid
PythonGoRust +5 more

Helix AI Engineer, Training Performance

2mo ago
F

Figure AI

Figure is an AI robotics company developing autonomous general-purpose humanoid robots with the goal of shipping human-level intelligence. The Helix team is seeking an experienced AI Training Performance Engineer to elevate model training. This role focuses on enhancing distributed training frameworks for large-scale model training, optimizing GPU kernels, evaluating different accelerator types, and co-designing models for maximum hardware utilization.

$200k - $400k

San Jose, CA onsite Full-time
PythonPyTorchJAX +5 more

Software Engineer, Voice Model

7mo ago
x

xAI

You'll join the Grok Voice Model team as a software engineer. You'll design, build, and run the software systems behind Grok Voice, which delivers natural, low-latency, multilingual spoken interactions across devices and in real time. The team owns the full engineering stack behind the model, from large-scale data processing to distributed training to production deployment.

$150k - $450k

Palo Alto, CA onsite
KubernetesPythonFine-Tuning +9 more

Forward Deployed Engineer, Post-Training

7d ago
Together AI

Together AI

As a Forward Deployed Engineer (FDE) focused on Post-Training, you will be a hands-on technical partner to strategic customers who are using fine-tuning and reinforcement learning to build differentiated models on open-source foundations. You will work alongside Solutions Architects as the deep-domain specialist in post-training, guiding customers through data strategy, algorithm selection, experiment design, and evaluation, and sizing the compute required. Your role is crucial in ensuring the successful delivery of post-training Proofs of Concept (POCs), driving adoption of the fine-tuning and RL platform, and translating customer goals into measurable improvements in model quality. This position directly impacts customer success, company growth, and the enhancement of our core platform.

$270k - $300k

San Francisco onsite Full-time
Open Source ModelsPythonLLM +2 more

Forward Deployed Engineer, Strategic Inference

5mo ago
Together AI

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and company growth.

$270k - $300k

San Francisco onsite Full-time
PythonLLMFine-Tuning +5 more

Software Engineer - Turso

9d ago
Supabase

Supabase

Supabase is seeking a Software Engineer to join their Turso core database team. This role focuses on advancing the future of agentic databases, specifically by contributing to the Turso Open Source database and its Cloud offering. You will work on enhancing Postgres compatibility, ensuring system reliability, maintaining cloud operations, and improving scalability to support a massive increase in database usage. The ideal candidate thrives in a fast-paced, asynchronous environment and is passionate about building scalable database technologies for a world with millions of daily agent-created databases.

Salary not listed

Remote, Global remote Full-time
AWSKubernetesRust +4 more

Senior Fullstack Engineer (m/f/d) - AI Health tech

10d ago
voize

voize

voize is building AI companions to seamlessly take over digital workflows for frontline workers, amplifying their impact rather than replacing them. With significant Series A funding and a growing user base, the company is seeking a Senior Fullstack Engineer to co-own its in-house ML App. This platform is crucial for annotation, data exploration, ML training orchestration, model evaluation, and managing sensitive data flows, aiming to make external vendor solutions unnecessary.

Salary not listed

Warsaw, Poland hybrid Full-time
TypeScriptCI/CDReact +1 more

SDK Engineer - Python

14d ago
Supabase

Supabase

Supabase is seeking a Python SDK Engineer to join their SDK team. This role focuses on enhancing how developers interact with Supabase through Python, ensuring the SDK is a library that Python developers genuinely enjoy using. You will work on building and evolving the Python SDK across various Supabase services, including database, auth, storage, realtime, and functions, with both synchronous and asynchronous APIs. The position involves proactive development, identifying and building missing features, and contributing to the open-source community. A key aspect of this role is owning the typing experience for the SDK, ensuring it's fully typed and checker-friendly, and maintaining compatibility across diverse Python environments and frameworks. You will also be responsible for tracking platform changes and reflecting them in the SDK, designing public APIs, and making the SDK legible to AI coding agents.

Salary not listed

Remote, Global remote Full-time
PythonAI AgentsPostgreSQL

Software Engineer, Model Lifecycle and Signals

16d ago
Cursor

Cursor

SpaceXAI is building Super Intelligence to help humanity understand the universe, from supercomputers to large language models and user-facing applications. As a Software Engineer on the Model Lifecycle and Signals team, you will be responsible for integrating frontier models into user-facing products at a massive scale. This role involves deciding which models to use, monitoring their performance, and providing feedback to shape future model development. You will work at the intersection of infrastructure, data, and product, bringing models from preview to production, analyzing real-world data, and collaborating with research, inference, product, and data science teams to improve both products and models. Your contributions will have a compounding impact across all products and shipped models.

Salary not listed

New York onsite Full-time
PythonLLMAI Agents +4 more

Machine Learning Engineer – Lumen Enterprise Models (SWE-focused LLMs)

15d ago
C

Cosine

Cosine is developing autonomous software-engineering systems for organizations that prioritize reliability, security, and control. Our Lumen Enterprise models are designed to understand and modify real codebases, utilizing tools, running tests, and producing maintainable software. We are seeking a Machine Learning Engineer to enhance and train these models across the entire training stack, including pre-training, supervised fine-tuning, and reinforcement learning. This role offers exposure to all facets of the model training lifecycle, from performance profiling to implementing new RL algorithms, and requires a hands-on approach with a focus on software quality.

Salary not listed

London Office onsite Full-time
KubernetesFine-TuningPyTorch +4 more

Senior Compiler Engineer, AI IP

19d ago
T

Tenstorrent

Tenstorrent is a leader in AI technology, focusing on performance, ease of use, and cost efficiency. We are building a high-performance RISC-V CPU and a comprehensive AI platform. Join our AI IP software team to help customers integrate AI workloads into products built on Tenstorrent technology. This role involves working directly with customers to integrate models, answer technical questions, and solve integration challenges across models, compilers, and runtime workflows. It's a hands-on software role with opportunities to learn and contribute to cutting-edge AI technology.

Salary not listed

Belgrade, Serbia hybrid Full-time
Computer VisionONNXC++

Member of Technical Staff, Post-Training (India)

21d ago
H

Handshake AI

Handshake AI works with frontier labs on their most consequential data, evaluation, and post-training challenges, building systems that turn expert human knowledge into data and evaluations to improve frontier models. Handshake Labs is developing external AI products, research platforms, and customer-facing AI systems, evolving custom-built work into reusable products and platforms. This role is for a Member of Technical Staff, Post-Training, a broad, high-ownership position for researchers who build, requiring the ability to reason deeply about model improvement and translate that reasoning into reliable systems. You will partner with researchers, domain experts, and customers to transform ambiguous post-training questions into experiments, evaluation frameworks, data pipelines, and products, with significant influence over technical direction and culture.

Salary not listed

India onsite Full-time
PythonFine-TuningPyTorch +2 more

ML Systems Engineer - Model Training and Infrastructure (SWE-focused LLMs)

21d ago
C

Cosine

We are seeking an ML Systems Engineer to contribute to the training of our Lumen LLMs, which are based on open-source software engineering models. This role is interdisciplinary, involving the development and deployment of reinforcement learning training environments, working with large-scale synthetic data pipelines, and building an ML platform for training large models in distributed settings. The goal is to train models that not only provide correct answers but also write readable, maintainable code aligned with architectural patterns. This position is ideal for someone passionate about the evolving landscape of coding agents, where data, RL environments, and opinionated reward functions are shaping future SWE model standards.

Salary not listed

London Office onsite Full-time
AWSDockerKubernetes +5 more

Member of Technical Staff, AI Engineering (India)

21d ago
H

Handshake AI

Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building systems that turn expert human knowledge into data and evaluations that improve frontier models. Handshake Labs is building external AI products, research platforms, and customer-facing AI systems, evolving custom-built work into reusable products and platforms. This role focuses on building the data systems essential for frontier model training, improving how we generate, process, and prepare complex and sensitive data, whether through synthetic data generation or anonymization while preserving structure. You will partner with researchers, domain experts, legal/compliance stakeholders, and customers to translate ambiguous data questions into experiments, pipelines, and durable products, with significant influence over technical direction, standards, and culture.

Salary not listed

India onsite Full-time
PythonReinforcement Learning

Lead Backend Engineer (Modeling & Simulation)

27d ago
Code Metal

Code Metal

Code Metal is seeking a Lead Backend Engineer to join their Modeling & Simulation team. This role will lead the backend and data engineering team responsible for building the Python services, APIs, and data systems that power a next-generation wargaming and decision-support platform. The ideal candidate will balance people leadership with hands-on technical ownership, providing Principal-level backend engineering judgment, guiding architecture, and tackling complex technical challenges while growing a team of engineers. This platform is crucial for enabling government users to make critical multi-billion-dollar force-design decisions.

$253k - $294k

Boston Hub remote Full-time
AWSAzureGoogle Cloud +4 more

Senior Backend Engineer

1mo ago
M

Montecarlodata

Monte Carlo is seeking a Senior Fullstack Engineer to join their team and build the core of their agent trust platform. This role involves developing backend services, distributed systems, and agentic workflows that enable enterprises to monitor and trust AI in production. You will take ownership of problems from initial concept through prototyping, architecture, development, testing, and deployment, ensuring reliability, observability, and scalability as the platform grows. The position is primarily backend-focused but includes shipping React surfaces when necessary, and involves building and maintaining data pipelines for analytics, ML, and customer-facing features. You will collaborate with product, ML, and infrastructure teams to deliver customer value.

$180k - $230k

Remote, US remote Full-time
AnthropicAWSPython +8 more

Software Engineer, AI Systems (United States)

1mo ago
L

LandingAI

Haven Safety AI is building an enterprise learning intelligence layer for safety, designed to help high-risk organizations learn faster from incidents and prevent future occurrences. The platform integrates with existing EHS systems to enhance incident investigation, assessment, and learning processes. It leverages current incident evidence, company knowledge, historical cases, and an industry knowledge graph, with specialized AI agents analyzing various data points to produce traceable assessments. This role is a build-and-operate position focused on the AI and LLM engineering layer, connecting the evidence base and knowledge graph to the product experiences used by investigators and safety leaders. The work is technically demanding and operationally critical, serving enterprise customers in regulated, safety-critical industries where precision, traceability, evaluation, and human oversight are paramount.

Salary not listed

United States onsite Full-time
OpenAIAnthropicLangGraph +8 more

Software Engineer-AI Model Bring Up

11mo ago
T

Tenstorrent

This role sits at the intersection of technical expertise and customer engagement, focused on helping customers and internal teams bring up and optimize AI models on Tenstorrent platforms. As a Software Engineer on the AI Models / System Bring-Up team, you will be responsible for porting, validating, and optimizing AI models on Tenstorrent platforms. Working across models, runtime software, and hardware, you will help connect new models, models not yet running on Tenstorrent hardware, and research-stage workloads to stable, high-performance systems.

Salary not listed

Tokyo, Japan hybrid Full-time
PythonPyTorchTensorFlow +4 more

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

2mo ago
Together AI

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and platform hardening.

Salary not listed

Singapore onsite Full-time
PythonFine-TuningReinforcement Learning +1 more

AI Compiler Engineer

4mo ago
E

EnCharge AI

EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the development and optimization of graph compilers tailored for cutting-edge AI and ML workloads. This role involves collaborating with hardware architects and AI researchers to enhance performance, optimize computation graphs, and enable efficient model deployment on EnCharge's Inference Accelerators. The ideal candidate will architect, design, and implement optimizations for AI model execution on graph compilers to improve performance, reduce latency, and maximize hardware utilization.

$190k - $255k

Remote-US, Canada, Germany and Norway remote Full-time
PythonPyTorchTensorFlow +2 more

Senior Software Engineer, Backend Platform

1mo ago
H

Handshake AI

Handshake is seeking a Senior Software Engineer to join the Backend Platform team, with a primary focus on supporting Handshake AI (HAI) and internal AI initiatives. This role involves building and maintaining backend services, shared platform capabilities, and developer tooling. The work will center on core backend platform concerns such as service architecture, APIs, data systems, performance, reliability, and developer experience, with an increasing use of LLMs and agents. The ideal candidate will possess strong backend fundamentals combined with practical knowledge of LLM-powered and agentic systems.

$208k - $260k

San Francisco, CA onsite Full-time
Google CloudDockerKubernetes +9 more

Questions about startup LLM Engineer jobs

How many startup LLM Engineer jobs are open?
There are 28 open startup LLM Engineer jobs on AiRagJobs right now, the newest posted 1d ago. New roles are added every day.
How much do startup LLM Engineer jobs pay?
The median posted salary range is $204k–$300k, from 12 jobs here that list pay. That's base salary; equity and bonuses aren't included. See the full salary guide
Which companies are hiring for startup LLM Engineer jobs?
Handshake AI, Together AI, xAI, Cosine and Parallel Wireless have the most open roles right now.
What counts as a startup here?
Companies from seed to Series B, going by their latest funding round. Later-stage and public companies are on the other pages.