Triton Inference Server Jobs

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. As a Senior Machine Learning Engineer on the Applied AI team, you will own model and endpoint optimization from model artifacts through production deployment. Your work will focus on improving latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving quality and reliability. You will collaborate with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions. Your improvements will be validated through reproducible benchmarks and safe production rollouts under real-world workloads.

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. As a Senior Machine Learning Engineer on the Applied AI team, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization, model compression, speculative decoding, KV-cache optimization, inference engines, and serving architecture to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving model quality and reliability. You will collaborate with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions, validating improvements through reproducible benchmarks and safe production rollouts.

$195k - $262k

Pulse is seeking a Machine Learning Engineer to develop specialized vision and language models that drive our document understanding platform. You will have the autonomy to train and fine-tune models, and to deploy improvements into production. This role is ideal for someone passionate about the intersection of computer vision, NLP, and data infrastructure, who wants to directly impact customers and shape the future of document intelligence.

$160k - $220k