Senior Staff Software Engineer - AI Agent Platform
$200k - $391k • Remote • US, CA, Santa Clara
Posted 3d ago
About the job
We are seeking a Senior Engineer to design, build, and scale the infrastructure that powers NVIDIA's AI agent ecosystem. This role sits at the intersection of distributed systems, developer platforms, and agentic AI, focusing on building foundational services that enable teams across the company to develop, deploy, orchestrate, and operate autonomous AI agents at production scale. You will be instrumental in creating the core platform that supports the full agent lifecycle, from registration to teardown, ensuring robust and scalable operations.
Responsibilities
- Build and develop platform services for the full agent lifecycle (registration, deployment, execution, teardown).
- Architect multi-tenant Kubernetes execution environments with isolation and policy enforcement.
- Develop and maintain CI/CD pipelines using GitLab CI and ArgoCD for agent development and deployment.
- Build framework-agnostic infrastructure supporting multiple agent SDKs and harnesses.
- Build and operate Kafka-based message pipelines and real-time event streaming.
- Develop data ingestion pipelines, access interfaces, and storage layers for AI agent knowledge.
- Implement session management for state persistence, conversation history, and agent recovery.
- Develop multi-layer authentication and manage secrets lifecycle with Vault.
- Partner with security teams on compliance, access controls, and approval workflows for agent operations.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience).
- 12+ years in software engineering, ideally in platform engineering, infrastructure, or developer tools.
- Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph.
- Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management.
- Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks.
- Proven track record designing distributed systems with Kafka, Redis, and MongoDB or PostgreSQL.
- Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD.
- Experience designing AI data platform components (ingestion pipelines, vector stores, retrieval APIs, data preprocessing workflows).
- Solid grasp of auth and identity: OAuth 2.0, JWT, token exchange, and secrets management with Vault.
- History of leading sophisticated technical projects and strong interpersonal skills.
Benefits
- Equity
- Benefits