Senior Staff Software Engineer - Agentic IT Operations

Remote • US, CA, Santa Clara

Posted 1d ago

Remote Work Policy

Fully remote

Categories

AI Agent Engineer

About the job

NVIDIA is seeking a Senior Staff Software Engineer to define the technical strategy for autonomous AI-driven enterprise operations. This role involves setting the architecture to transform IT from manual workflows into agentic platforms operating at a global scale. As a senior individual contributor, you will tackle complex technical challenges, establish industry standards for other engineering organizations, and make architectural decisions with long-term impact. Exceptional communication skills are essential for success in this influential position.

Responsibilities

  • Define the technical strategy and reference architecture for agentic AI across enterprise IT, including runtimes, tool interfaces, memory management, orchestration, evaluation, and safety guardrails.
  • Architect and build production agentic systems using LLM-based agents, tool calling, RAG, and orchestration frameworks for AI-assisted operations.
  • Design autonomous agents to execute complex, multi-step enterprise workflows end-to-end, managing approvals, vendor handoffs, data reconciliation, and exception handling with human-in-the-loop controls.
  • Own the reliability, observability, failure semantics, and blast-radius controls for enterprise-scale autonomous systems.
  • Oversee the architecture of the integration and automation platform for systems like ServiceNow, ERP, and endpoint management, including infrastructure, data pipelines, APIs, and applications.
  • Define engineering standards for building, testing, evaluating, and operating agentic systems, covering prompt/tool versioning, evals, regression, cost/latency budgets, security, and failure analysis.
  • Drive technical alignment across organizational boundaries, resolving architectural decisions and building consensus without formal authority.
  • Mentor and grow senior and staff engineers through design partnerships, code reviews, and technical coaching.
  • Raise the engineering bar through shipped work and enforced standards.

Requirements

  • Bachelor's or Master's degree in a related field, or equivalent experience.
  • 12+ years of hands-on software engineering experience building and operating production systems at scale.
  • Deep expertise in at least one of: Infrastructure, SRE, DevOps, Platform, or Production Engineering.
  • Demonstrated impact with architectural decisions shaping systems across multiple organizations.
  • Proven track record of being the go-to person for the hardest technical problems.
  • Deep expertise in designing and shipping production software systems integrations, automation platforms, APIs, and data pipelines for complex enterprise operations.
  • Proven experience taking agentic AI or LLM-based systems to production, including multi-step autonomous execution, tool calling, RAG, human-in-the-loop safeguards, exception handling, evaluation, and governance.
  • Track record of modernizing enterprise IT operations platforms and migrating or replacing legacy systems.
  • Production-grade proficiency with infrastructure-as-code, CI/CD, containerization (Kubernetes), and cloud platforms (AWS, GCP, or Azure).
  • Experience with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog).
  • Fluent in Python, Go, or equivalent languages, with the ability to write and review production-quality code.
  • Demonstrated ability to grow other senior engineers and establish enduring engineering practices.
  • Ability to drive technical direction across engineering, product, and senior leadership without formal authority.
  • Ability to make complex trade-offs legible to VP and C-level audiences in business terms.

About nvidia

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.