Senior Systems Engineer -- Agentic AI
$224k - $431k • Remote • US, TX, Austin
Posted 3d ago
Job Location
US, TX, Austin
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Agent Engineer
About the job
NVIDIA is seeking a Senior Software Architect to join the Agent Harness & Runtime Engineering team. This role focuses on building foundational systems for the next generation of agentic AI, operating at the intersection of AI and systems engineering. You will tackle challenges across agent runtimes, inference, evaluation, and large-scale execution, translating rapidly evolving AI capabilities into scalable, production-quality systems. The ideal candidate will possess AI breadth to understand emerging problems, systems depth to architect solutions at scale, and engineering strength to build them.
Responsibilities
- Architect and build scalable, reliable systems for agentic AI, including agent runtimes, harnesses, inference, evaluation, and orchestration.
- Solve large-scale systems challenges across distributed execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute environments.
- Optimize systems for reliability, scalability, performance, resource utilization, and developer experience.
- Prototype emerging ideas, write high-quality production code, and provide technical leadership across research, engineering, product, and infrastructure teams.
Requirements
- BS, MS, or equivalent experience in Computer Science, Computer Engineering, AI, or a related field, with 12+ years of relevant industry experience.
- Strong foundation in modern AI, including LLMs, multimodal models, inference, agentic AI, and evaluation.
- Deep expertise in software architecture, distributed systems, and large-scale systems design.
- Strong hands-on programming skills in Python, C++, Go, Rust, or similar languages, with a track record of building high-quality production software.
- Background building large-scale systems involving distributed execution, data processing/ETL, workflow orchestration, HPC, cloud, or GPU infrastructure.
- Ability to reason across the stack—from AI model behavior and application logic to runtime, compute, and infrastructure.
- Proven ability to take ambiguous, complex technical problems from architecture through implementation and production.
Benefits
- Equity
- Benefits