New: upload your resume and get matched to AI jobs. Free to start →

Senior Principal Researcher - AI Systems Architecture

$166k - $296k • United States, California, Mountain View • Full-time

Posted 1mo ago

Job Location

United States, California, Mountain View

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

Microsoft Research is seeking a Senior Principal Researcher to define and build next-generation AI systems. This role focuses on the architecture of AI systems, connecting frontier model behavior with runtime, memory, interconnect, and hardware. You will drive research from initial analysis and modeling through to prototype evaluation and technology transfer, working across various Microsoft teams including AI infrastructure, systems software, and silicon engineering. The goal is to improve sustained inference throughput, accelerator utilization, energy efficiency, and the economics of large-scale AI infrastructure.

Responsibilities

  • Lead end-to-end AI system, memory, and hardware architecture research, identifying cross-layer opportunities.
  • Develop architectural abstractions and mechanisms to connect AI model execution behavior with platform capabilities.
  • Analyze emerging AI workloads, including computation, memory access, communication, data movement, bandwidth, latency, capacity, and power requirements.
  • Drive pre-silicon architectural exploration, performance modeling, feasibility analysis, and implementation pathfinding for next-generation AI hardware.
  • Evaluate trade-offs across performance, bandwidth, latency, power, thermal limits, silicon area, packaging, and total cost of ownership.
  • Build analytical models, simulators, prototypes, and experimental systems to validate architectural hypotheses.
  • Collaborate across research and product engineering, publish research, mentor technical contributors, and transfer promising concepts toward deployment.

Requirements

  • Doctorate in Computer Science, Computer Engineering, Electrical Engineering, or relevant field AND 6+ years related research experience, OR Master's Degree AND 7+ years related research experience, OR Bachelor's Degree AND 9+ years related research experience, OR equivalent experience.
  • Extensive experience in computer architecture, memory systems, silicon architecture, AI systems, platform design, or hardware/software co-design.
  • Experience reasoning across workload behavior, system software, memory hierarchy, interconnects, and hardware architecture.
  • Experience with pre-silicon architecture definition, modeling, feasibility analysis, or highly parallel accelerator-based systems.
  • Record of technical innovation demonstrated through research, patents, publications, prototypes, architecture delivery, or product deployment.
  • Experience with DRAM, HBM, CXL, GPU memory systems, host-memory interfaces, or high-bandwidth memory architectures.
  • Experience with accelerator-attached memory, advanced packaging, 2.5D/3D integration, or high-speed scale-up interconnects.
  • Experience analyzing large AI workloads such as LLM inference or training, mixture-of-experts routing, and KV-cache behavior.
  • Experience developing performance models, cycle-accurate simulators, prototypes, or performance-analysis infrastructure.
  • Experience translating new memory or hardware capabilities into measurable system-level improvements.
  • Experience evaluating bandwidth, latency, capacity, locality, power, thermal, area, and data-movement trade-offs.
  • Publication or patent record in computer architecture, systems, memory systems, AI infrastructure, or hardware platforms.
  • Experience collaborating across research, pre-silicon design, and product engineering organizations.

Benefits

  • Base pay range: USD $165,600 - $296,400 per year (US)
  • Base pay range: USD $220,800 - $331,200 per year (San Francisco Bay area and New York City metropolitan area)
  • Certain roles may be eligible for benefits and other compensation.