Software Engineer II - AI Infrastructure
$102k - $202k • United States, California, Mountain View; United States, Washington, Redmond • Full-time
Posted 18d ago
Job Location
United States, California, Mountain View; United States, Washington, Redmond
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
Join the Cloud + AI team as a Software Engineer to build secure, scalable, and high-performance AI experiences across various modalities, including real-time audio, image generation, video generation, and AI safety systems. You will work across the full technology stack, from APIs and platform services to the inference infrastructure that serves AI models at massive scale. This role involves contributing to systems that power products used by millions, while advancing the reliability, safety, and efficiency of AI platforms. We are looking for individuals who thrive in fast-paced, collaborative environments and enjoy solving complex technical challenges.
Responsibilities
- Design and build scalable, reliable AI inference backends and API interfaces.
- Apply distributed systems principles to create robust AI solutions.
- Debug and optimize AI system components across the full stack.
- Collaborate with internal teams and external partners to solve complex problems and deliver integrated solutions.
- Identify innovative technical approaches to unlock new AI possibilities.
- Architect and execute features with measurable goals, iterating rapidly.
- Engage with components from infrastructure to APIs to deliver end-to-end AI solutions.
Requirements
- Bachelor's Degree in Computer Science or related technical field and 2+ years of technical engineering experience, including coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Experience with distributed systems, scalable architecture, and API design.
- Understanding of ML/AI fundamentals and practical applications.
- Experience in delivering AI-based solutions.
- Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, or LangChain.
- Optional experience with OpenAI API / Azure OpenAI.
- Strong communication, collaboration, problem-solving, and decision-making abilities.
Benefits
- Base pay range: USD $102,100 - $202,200 per year (US-wide)
- Base pay range: USD $133,800 - $219,200 per year (San Francisco Bay area and New York City metropolitan area)
- Certain roles may be eligible for benefits and other compensation.
