KV-cache optimization Jobs

Nebius is building a full-stack AI cloud platform to support developers and enterprises in the global AI economy, from data and model training through to production deployment. The Nebius Token Factory is seeking scientists to tackle frontier LLM and VLM inference bottlenecks by turning them into research questions, conducting rigorous experiments, and translating findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts for engineers to build upon. Your research will cover areas like quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will evaluate trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and collaborate with engineering teams to bring promising results into production.

$195k - $262k