New: upload your resume and get matched to AI jobs. Free to start →

Principal AI Network Architect

$143k - $275k • United States, Washington, Redmond; United States, California, Mountain View; United States, Texas, Austin; United States, North Carolina, Raleigh; United States, Oregon, Hillsboro • Full-time

Posted 7d ago

Job Location

United States, Washington, Redmond; United States, California, Mountain View; United States, Texas, Austin; United States, North Carolina, Raleigh; United States, Oregon, Hillsboro

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is responsible for powering Microsoft's "Intelligent Cloud" mission by delivering core infrastructure and foundational technologies for over 200 online businesses. As Microsoft's cloud business grows, the ability to deploy new offerings and hardware infrastructure efficiently and with high quality is paramount. The Cloud Hardware Systems Engineering (CHSE) team plays a crucial role in defining and delivering operational measures of success for hardware manufacturing, improving planning, quality, delivery, scale, and sustainability for Microsoft cloud hardware. We are seeking engineers passionate about customer-focused solutions and industry knowledge to envision and implement future technical solutions for managing and optimizing cloud infrastructure. We are looking for a Principal AI Network Architect to join this dynamic team.

Responsibilities

  • Define the long-term architecture and technology roadmap for Microsoft's AI scale-up networking systems.
  • Architect next-generation scale-up switches, including system architecture, switch topology, ASIC selection, radix planning, and electrical/optical interconnect strategies.
  • Define network architectures for AI clusters, racks, pods, and multi-rack scale-up domains.
  • Drive architecture tradeoff analysis across performance, scalability, reliability, power, cost, serviceability, and operational efficiency.
  • Define scale-up network requirements based on AI training, inference, and emerging workload demands.
  • Lead architecture studies for switch silicon, optics, interconnect technologies, control planes, and AI fabrics.
  • Define switch system requirements, architecture specifications, and design guidelines for future Microsoft AI platforms.
  • Drive architecture decisions for scale-up and scale-out networks, including topology, oversubscription, resiliency, fault tolerance, and workload placement optimization.
  • Partner with system, silicon, optics, software, firmware, and operations teams to co-design end-to-end AI infrastructure solutions.
  • Develop performance, capacity, reliability, and TCO models to evaluate architecture alternatives and guide investment decisions.
  • Evaluate emerging networking technologies and influence industry roadmaps across switch silicon, optics, and networking ecosystems.
  • Provide technical direction and architectural guidance to switch development teams, ODM/JDM partners, and platform engineering organizations.

Requirements

  • Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years of technical engineering experience, OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years of technical engineering experience, OR equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements.
  • Must pass Microsoft Cloud Background Check upon hire and every two years thereafter.
  • Must provide proof of country of citizenship or U.S. permanent residency/protected status for export control assessment.
  • BS/MS in Electrical/Computer Engineering or equivalent industry experience.
  • 10+ years of relevant experience in system-level design/implementation across the hardware development lifecycle (compute, storage, networking, accelerator).
  • 10+ years of hands-on experience in server hardware architecture, design, and development with a solid understanding of hardware, firmware, and OS.
  • Proven experience delivering AI and GPU-based systems to production.
  • 10+ years of experience in networking, distributed systems, AI infrastructure, or large-scale system architecture.
  • Deep understanding of AI scale-up and scale-out networking architectures.
  • Experience architecting high-performance network switches and large-scale switching systems.
  • Knowledge of Ethernet, RDMA/RoCE, SONiC, network operating systems, and control plane architectures.
  • Experience with switch ASICs, SerDes technologies, retimers, PHYs, and high-speed electrical interconnects.
  • Experience with optical networking technologies including OCI, XPO, CPO, OBO.