distillation Jobs

5 open roles mentioning distillation

Senior Applied Scientist, Efficient LLM Inference & Model Optimization

4d ago
N

Nebius

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy, from data and model training through to production deployment. The Nebius Token Factory is seeking scientists to tackle frontier LLM and VLM inference bottlenecks by turning them into research questions, conducting rigorous experiments, and translating findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts for engineers to build upon. Your research will cover areas like quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will evaluate trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and collaborate with engineering teams to bring promising results into production.

$195k - $262k

Palo Alto, California, United States remote
PythonLLMPyTorch +9 more

ML Engineer, LLM's

11d ago
K

Knowtex

Knowtex is seeking an ML Engineer / Researcher focused on Large Language Models to contribute to the next generation of their AI stack. This role involves developing and optimizing models for clinical documentation and structured clinical reasoning, aiming to enhance quality, cost, latency, and control. The position is research-heavy with a direct path to production, requiring the design of experiments, building datasets and evaluation systems, and fine-tuning and post-training models. The successful candidate will collaborate closely with engineering and clinical teams to deploy solutions at scale and will play a key role in shaping Knowtex's long-term LLM strategy.

San Francisco hybrid FullTime
AWSPythonFine-Tuning +11 more

Staff Gen AI Research Scientist 

12d ago
A

Anduril Industries

Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. The Air Dominance & Strike team develops aerial and multi-domain robotic systems, including unmanned fighter jets and cruise missiles, and the Lattice for Mission Autonomy software platform. We are seeking an AI Research Scientist to be a founding ML expert, designing, fine-tuning, and deploying generative AI, LLMs, and agentic systems for our air-dominance platforms. This is a highly applied research role focused on making state-of-the-art LLM models smaller, faster, and smarter, optimizing them for both offboard systems and power-constrained edge hardware. As an early member, you will have significant autonomy to set technical direction, design data collection strategies, and influence multi-agent autonomy deployment.

$220k - $292k

Costa Mesa, California, United States; Seattle, Washington, United States; Washington, District of Columbia, United States onsite
LangChainLlamaIndexPython +15 more

Member of Technical Staff, Post-Training & Applied Research

1mo ago
S

SF Tensor

SF Tensor is building the future of high-performance compute for AI by optimizing the entire stack, from hardware to cloud. They are developing a Kernel Optimizer for faster, cheaper, and more accessible compute, and a Model Foundry to manage experiments and move workloads across clouds and chips. This role focuses on the modeling side of their enterprise offering, which aims to turn customer datasets into specialist models in days. The infrastructure is designed to accelerate research and model training, enabling rapid experimentation and deployment.

$275k - $315k

San Francisco onsite FullTime
PyTorchJAXDistributed Training +8 more

Machine Learning Engineer

1mo ago
H

Hyperbound

Hyperbound is seeking a Machine Learning Engineer to build and ship the models powering their Revenue Activation Platform. This role involves owning the full lifecycle of models, from training and fine-tuning open-source models to deploying them in production and ensuring their performance. You will focus on pushing models on-device, building robust evaluation frameworks, and contributing to the company's agentic operating system for sales. This is a challenging, fast-paced role where you'll work closely with founders and engineering, with significant input into product development.

$260k - $300k

San Francisco onsite FullTime
Open Source ModelsFine-TuningEvaluation Frameworks +5 more

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.