Senior Engineer, Local AI - Agents and Systems
$184k - $357k • US, CA, Santa Clara
Posted 20d ago
About the job
Artificial intelligence is shifting from passive help to autonomous, always-on workflows. Our mission is to make this change seamless, efficient, and secure for millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX GPUs. You will guide development so open-source AI agents operate locally, safely, and efficiently on consumer PCs. By combining powerful local inference with strong privacy routers and sandboxed execution, you will help develop the foundation of the desktop AI operating system.
Responsibilities
- Lead the development of agent frameworks natively on Windows, building a technical roadmap for AI assistants on GeForce RTX PCs.
- Optimize agent runtimes for Windows, ensuring autonomous agents operate within detailed privacy and security frameworks.
- Partner with internal AI research and driver teams, and the open-source community to create an excellent ecosystem for autonomous agents on consumer hardware.
- Foster a collaborative engineering culture through mentoring, establishing AI agent deployment guidelines, and writing production-ready code.
Requirements
- 10+ years of professional software engineering experience, with at least 3 years in a Staff or Lead Architect role.
- BS, MS, or PhD in Computer Science, Computer Engineering, or related technical field (or equivalent experience).
- Deep understanding of Windows OS internals, process isolation, sandboxing technologies, and system-level security architecture.
- Proven understanding of LLM inference pipelines (Ollama, Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT), and experience running local models on consumer hardware.
- Practical experience with modern AI orchestration and agentic frameworks (e.g., OpenClaw, Hermes, LangChain) and understanding of multi-agent systems.
- Proficiency in C++ and Python.
- Experience building virtualization, containerization, or robust sandboxing tools natively for the Windows ecosystem.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity