Software Engineer, AI/ML Infrastructure

$175k - $270k • Remote • Mountain View, CA

Posted 9d ago

Remote Work Policy

Fully remote

Categories

AI Infrastructure Engineer

About the job

Glean is seeking software engineers to contribute to building a leading search and assistant product for the workplace. Engineers will work across the technology stack, focusing on areas such as generative AI, Retrieval Augmented Generation (RAG), query and document understanding, domain-adapted language models, natural language question-answering, and evaluation. The role involves close interaction with customers to understand their challenges and applying the most effective tools to solve them.

Responsibilities

  • Design, build, and improve AI/ML systems and data pipeline infrastructure, including platforms for large language model serving, routing, and orchestration at scale.
  • Collaborate with and support engineers focused on modeling and agentic capabilities.
  • Develop agentic systems that use AI to proactively monitor, diagnose, debug, and maintain infrastructure health across cloud deployments.
  • Write robust, readable, maintainable, and testable code.
  • Mentor junior engineers or learn from experienced team members.

Requirements

  • 2-6 years of experience.
  • Bachelor's or Master's degree in Computer Science, Mathematics, Sciences, or a related field.
  • Demonstrated ability to design, build, and ship production-ready software, particularly in AI/ML infrastructure (e.g., batch processing pipelines, serving infrastructure).
  • Strong coding proficiency in Python, Go, or Java.

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.