New: upload your resume and get matched to AI jobs. Free to start →

Software Engineer II - AI Infrastructure

$102k - $202k • United States, California, Mountain View; United States, Washington, Redmond • Full-time

Posted 18d ago

Job Location

United States, California, Mountain View; United States, Washington, Redmond

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

Join the Cloud + AI team as a Software Engineer to build secure, scalable, and high-performance AI experiences across various modalities, including real-time audio, image generation, video generation, and AI safety systems. You will work across the full technology stack, from APIs and platform services to the inference infrastructure that serves AI models at massive scale. This role involves contributing to systems that power products used by millions, while advancing the reliability, safety, and efficiency of AI platforms. We are looking for individuals who thrive in fast-paced, collaborative environments and enjoy solving complex technical challenges.

Responsibilities

  • Design and build scalable, reliable AI inference backends and API interfaces.
  • Apply distributed systems principles to create robust AI solutions.
  • Debug and optimize AI system components across the full stack.
  • Collaborate with internal teams and external partners to solve complex problems and deliver integrated solutions.
  • Identify innovative technical approaches to unlock new AI possibilities.
  • Architect and execute features with measurable goals, iterating rapidly.
  • Engage with components from infrastructure to APIs to deliver end-to-end AI solutions.

Requirements

  • Bachelor's Degree in Computer Science or related technical field and 2+ years of technical engineering experience, including coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Experience with distributed systems, scalable architecture, and API design.
  • Understanding of ML/AI fundamentals and practical applications.
  • Experience in delivering AI-based solutions.
  • Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, or LangChain.
  • Optional experience with OpenAI API / Azure OpenAI.
  • Strong communication, collaboration, problem-solving, and decision-making abilities.

Benefits

  • Base pay range: USD $102,100 - $202,200 per year (US-wide)
  • Base pay range: USD $133,800 - $219,200 per year (San Francisco Bay area and New York City metropolitan area)
  • Certain roles may be eligible for benefits and other compensation.