2026-11 Senior/Staff Software Engineer

Remote • US Remote

Posted 7h ago

Remote Work Policy

Fully remote

Categories

AI Infrastructure Engineer

About the job

Vectara is seeking a Senior/Staff Platform Software Engineer to build and scale the core infrastructure powering their AI agent platform. This role involves designing robust services and scalable systems with a focus on automation, observability, reliability, and performance. You will work on AI-assisted coding, lead code and system design reviews, and mentor team members. The position requires designing, implementing, and maintaining scalable and secure backend services, driving infrastructure automation, CI/CD, and monitoring pipelines, and collaborating with product and research teams to deploy and optimize ML/NLP workloads. You will also lead initiatives to improve system reliability and scalability, contribute to architecture decisions, and champion best practices in code quality and DevOps.

Responsibilities

  • Utilize AI-assisted coding and manage AI agents for efficient task execution.
  • Lead code, system design, and architecture reviews, mentoring team members.
  • Design, implement, and maintain scalable and secure backend services and platform components.
  • Drive infrastructure automation, CI/CD, and monitoring/alerting pipelines.
  • Collaborate with product engineering and research teams to deploy, scale, and optimize ML/NLP workloads.
  • Lead initiatives to improve system reliability, scalability, and developer experience.
  • Contribute to architecture and infrastructure decisions for platform scaling.
  • Champion best practices in code quality, testing, and DevOps culture.

Requirements

  • 5+ years of experience as a software engineer focused on backend systems and platform engineering.
  • Proficiency in Java and Python.
  • Deep experience with computing environments (GCP, AWS, Onprem, or Azure).
  • Strong understanding of containerization and orchestration (Docker, Kubernetes).
  • Experience with infrastructure-as-code (Terraform, Pulumi).
  • Experience with observability tools (Prometheus, Grafana, ELK/EFK).
  • Experience working on ML platforms or supporting ML workloads in production.
  • Experience designing and operating distributed systems.
  • Familiarity with data infrastructure (e.g., Kafka, Spark, Airflow).

Benefits

  • Equity ownership in the company
  • 100% paid Medical, Dental, Vision insurance from the first day
  • Option of Health Savings Account (HSA) or Flexible Savings Account (FSA)
  • Generous paid time off (PTO)
  • Paid sick time
  • Paid holidays
  • Paid company rest days
  • Professional development and training opportunities
  • Company virtual happy hours
  • Team building activities

About Vectara

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.