Principal Engineer, Local AI - Agents and Systems

$272k - $431k • US, CA, Santa Clara

Posted 1d ago

Remote Work Policy

On-site

Categories

AI Agent Engineer

About the job

Artificial intelligence is shifting from passive help to autonomous, always-on workflows. Our mission is to make this change seamless, efficient, and secure for millions globally. We seek a Principal Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will guide development so open-source AI agents operate locally, safely, and efficiently on consumer PCs. By combining powerful local inference with strong privacy routers and sandboxed execution, you will help develop the foundation of the desktop AI operating system.

Responsibilities

  • Lead the development of agent frameworks natively on Windows environments, building the technical roadmap for AI assistants on GeForce RTX PCs and laptops.
  • Optimize agent runtimes for Windows, ensuring autonomous agents operate within detailed, policy-based privacy and security frameworks.
  • Partner with internal AI research and driver teams, and the open-source community to create an excellent ecosystem for autonomous agents on consumer hardware.
  • Mentor other engineers, establish guidelines for AI agent deployment, and write reliable, production-ready code.

Requirements

  • 15+ years of professional software engineering experience, with at least 3+ years in a Staff or Lead Architect role.
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related technical field (or equivalent experience).
  • Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
  • Proven understanding of LLM inference pipelines (e.g., Ollama, Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT), and experience running local models on consumer-grade hardware.
  • Practical experience with modern AI orchestration and agentic frameworks (e.g., OpenClaw, Hermes, LangChain) and understanding of multi-agent systems.
  • Proficiency in C++ and Python.
  • Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.

Benefits

  • Highly competitive salaries
  • Comprehensive benefits package
  • Eligibility for equity

About nvidia

Get new AI jobs in your inbox

A weekly digest of the newest AI engineering roles.

© 2026 AI Job Board. All rights reserved.