distillation Jobs
5 open roles mentioning distillation
Senior Applied Scientist, Efficient LLM Inference & Model Optimization
Nebius
Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy, from data and model training through to production deployment. The Nebius Token Factory is seeking scientists to tackle frontier LLM and VLM inference bottlenecks by turning them into research questions, conducting rigorous experiments, and translating findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts for engineers to build upon. Your research will cover areas like quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will evaluate trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and collaborate with engineering teams to bring promising results into production.
$195k - $262k
ML Engineer, LLM's
Knowtex
Knowtex is seeking an ML Engineer / Researcher focused on Large Language Models to contribute to the next generation of their AI stack. This role involves developing and optimizing models for clinical documentation and structured clinical reasoning, aiming to enhance quality, cost, latency, and control. The position is research-heavy with a direct path to production, requiring the design of experiments, building datasets and evaluation systems, and fine-tuning and post-training models. The successful candidate will collaborate closely with engineering and clinical teams to deploy solutions at scale and will play a key role in shaping Knowtex's long-term LLM strategy.
Staff Gen AI Research Scientist
Anduril Industries
Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. The Air Dominance & Strike team develops aerial and multi-domain robotic systems, including unmanned fighter jets and cruise missiles, and the Lattice for Mission Autonomy software platform. We are seeking an AI Research Scientist to be a founding ML expert, designing, fine-tuning, and deploying generative AI, LLMs, and agentic systems for our air-dominance platforms. This is a highly applied research role focused on making state-of-the-art LLM models smaller, faster, and smarter, optimizing them for both offboard systems and power-constrained edge hardware. As an early member, you will have significant autonomy to set technical direction, design data collection strategies, and influence multi-agent autonomy deployment.
$220k - $292k
Member of Technical Staff, Post-Training & Applied Research
SF Tensor
SF Tensor is building the future of high-performance compute for AI by optimizing the entire stack, from hardware to cloud. They are developing a Kernel Optimizer for faster, cheaper, and more accessible compute, and a Model Foundry to manage experiments and move workloads across clouds and chips. This role focuses on the modeling side of their enterprise offering, which aims to turn customer datasets into specialist models in days. The infrastructure is designed to accelerate research and model training, enabling rapid experimentation and deployment.
$275k - $315k
Machine Learning Engineer
Hyperbound
Hyperbound is seeking a Machine Learning Engineer to build and ship the models powering their Revenue Activation Platform. This role involves owning the full lifecycle of models, from training and fine-tuning open-source models to deploying them in production and ensuring their performance. You will focus on pushing models on-device, building robust evaluation frameworks, and contributing to the company's agentic operating system for sales. This is a challenging, fast-paced role where you'll work closely with founders and engineering, with significant input into product development.
$260k - $300k