Software Engineer, AI/ML Infrastructure

$175k - $270k Mountain View, CA

Posted 11d ago

Job Location

Mountain View, CA

Tech Stack

Remote Work Policy

On-site

Categories

AI Infrastructure Engineer

About the job

Glean is seeking software engineers to contribute to building a leading search and assistant product for the workplace. Engineers will work across the technology stack, focusing on areas such as generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. This role involves close interaction with customers to understand their challenges and applying the most effective tools to solve them.

Responsibilities

  • Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms for large language model serving, routing, and orchestration at scale.
  • Collaborate with and support engineers focused on modeling and Agentic capabilities.
  • Develop agentic systems that use AI to proactively monitor, diagnose, debug, and maintain infrastructure health across cloud deployments.
  • Write robust, readable, maintainable, and testable code.
  • Mentor junior engineers or learn from experienced team members.

Requirements

  • 2-6 years of experience.
  • Bachelor's degree in Computer Science, Math, Sciences, or a related field.
  • Demonstrated ability to design, build, and ship production-ready software, particularly in AI/ML infrastructure (e.g., Batch processing pipelines, Serving infrastructure).
  • Proficiency in coding languages such as Python, Go, or Java.

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.