New: upload your resume and get matched to AI jobs. Free to start →

Senior and/or Principal Software Engineer - AI Infrastructure

$120k - $235k • United States, Washington, Redmond; United States, California, Mountain View • Full-time

Posted 22d ago

Job Location

United States, Washington, Redmond; United States, California, Mountain View

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

AI Infra is at the forefront of Microsoft’s mission to redefine how software is built and experienced. We are responsible for building the foundational platforms, services, programming models, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. We build platforms to handle AI workloads for customers and have a significant business impact on products that ship across all Microsoft groups as well as enterprise customers. We are looking for a Senior/Principal Software Engineer who will define the future of engineering systems and developer productivity. In this role, you will build high-scale distributed services to support large scale state of the art model training and inference. We seek highly innovative experienced engineers to take the path ahead for services to support machine learning solutions, work on highly distributed platforms with 24x7x365 service availability and tight SLA and build comprehensive and intuitive end-end solutions to delight our customers.

Responsibilities

  • Architect, design, and develop core compute services powering AzureML for challenging AI problems using state-of-the-art LLM models.
  • Architect, design, and develop core AI Infrastructure services supporting large-scale AI training and inferencing.
  • Develop, test, and maintain backend services using C#, Go, Rust, or C++ on Kubernetes clusters and Docker containers.
  • Develop and operate training/inference infra frameworks and machine learning systems.
  • Enhance systems and applications for high stability, efficiency, maintainability, low latency, and cloud security.
  • Provide operational support and DRI responsibilities for the product.
  • Collaborate with engineers, data scientists, Microsoft Research teams, and external enterprises to build solutions.
  • Provide vision, expertise, and technical leadership to team members.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
  • Master's Degree in Computer Science or related technical field AND 8+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR Bachelor's Degree in Computer Science or related technical field AND 12+ years of technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python, OR equivalent experience.
  • Knowledge and first-hand experience with large model training systems.
  • 3+ years of experience operating and designing systems that support large model training.
  • Experience in distributed systems and architecture.
  • AI infrastructure and workload knowledge.

Benefits

  • Base pay range for IC4: USD $119,800 - $234,700 annually (US) or $160,200 - $261,000 (SF Bay Area/NYC).
  • Base pay range for IC5: USD $142,800 - $274,800 annually (US) or $188,000 - $304,200 (SF Bay Area/NYC).
  • Eligibility for other benefits and compensation.