New: upload your resume and get matched to AI jobs. Free to start →

ML Research Engineer

$102k - $202k • United States, Washington, Redmond; United States, California, Mountain View • Full-time

Posted 9d ago

Job Location

United States, Washington, Redmond; United States, California, Mountain View

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

LLM Engineer

About the job

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, a team dedicated to powering Microsoft’s “Intelligent Cloud” mission. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses, including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams, and Xbox Live. This role offers a unique career opportunity to innovate the latest hardware designs, combining technical capabilities with cross-team collaboration and business insight to propel Microsoft’s cloud growth.

Responsibilities

  • Design and develop novel quantization and numerics algorithms for efficient LLM inference and training in Azure production environments.
  • Drive proof-of-concept efforts for software development and model optimization tooling to streamline quantized model deployment.
  • Analyze performance bottlenecks in quantized LLM architectures and implement improvements.
  • Prototype and evaluate emerging low-precision data formats using hardware accelerator SDKs.
  • Co-design model architectures optimized for low-precision deployment in collaboration with AI/ML teams.
  • Work cross-functionally with data scientists and ML researchers/engineers to align on model accuracy and performance goals.
  • Partner with hardware architecture and AI software framework teams to ensure end-to-end system efficiency.

Requirements

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience, OR Master's Degree AND 1+ year related experience, OR Doctorate, OR equivalent experience.
  • Demonstrated experience delivering production-grade software in model compression, low-precision numerics, low-level kernel development, and performance optimization.
  • Proficiency with modern deep learning frameworks like PyTorch, TensorFlow, TensorRT, and ONNX Runtime.
  • Expertise in GPU/NPU kernel development using CUDA, Triton, ROCm, or comparable frameworks.
  • Strong understanding of Transformer and LLM architectures, with hands-on experience in optimization techniques such as quantization, pruning, model parallelism, and KV-cache optimization.
  • Practical experience with large-scale model evaluation, including benchmarking and fine-tuning large models.
  • Strong programming skills in Python, C, and C++.
  • Excellent communication and collaboration skills in hybrid team environments.
  • Experience creating publications (e.g., patents, peer-reviewed academic papers) is preferred.
  • Hands-on experience implementing and optimizing low-level linear algebra routines is a plus.
  • Deep knowledge of mixed-precision arithmetic units is highly desirable.