Senior AI Agent Test Developer, SDET
$168k - $322k • US, CA, Santa Clara • Full-time
Posted 18d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Agent Engineer
About the job
NVIDIA is seeking a Senior AI Agent Test Developer to drive quality and automation for AI agents and agentic workflows on NVIDIA GPU platforms. This role involves developing comprehensive test plans and strategies to validate the integration of models, agent harnesses, and inference runtimes. The successful candidate will build advanced QA solutions to enhance test development, execution, and failure analysis, making software testing smarter and more efficient.
Responsibilities
- Develop and utilize AI-powered tools to enhance software testing efficiency and effectiveness.
- Improve test case generation, defect detection, flaky test analysis, regression testing, and test coverage.
- Collaborate with product, engineering, and cross-functional teams to define test strategies based on requirements.
- Create test plans, design and execute test cases, and report on quality status, risks, bugs, and results.
- Conduct functional, performance, fault-injection, reliability, and regression testing for AI applications and agentic workflows.
- Automate test cases and contribute to scalable test frameworks and agent test harnesses.
- Manage the bug lifecycle, reproduce customer issues, and verify fixes.
Requirements
- MS or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
- 8+ years of QA, test automation, or software testing experience.
- Hands-on experience developing, testing, and maintaining AI agents or their components (models, agent harnesses, inference runtimes).
- Practical experience configuring, running, and debugging open-source models using at least one inference runtime or framework.
- Strong QA fundamentals, test strategy, test planning, and failure analysis skills.
- Proficiency with Unix/Linux, Python programming, and shell scripting.
- Experience with Kubernetes, containers, CI/CD pipelines, and cloud-native systems.
- Experience testing observability tools (e.g., Prometheus, Grafana, ELK Stack, Datadog).
- Experience with large-scale failure testing using frameworks like KWOK or Chaos Monkey.
- Strong communication, problem-solving skills, and curiosity for complex technology.
Benefits
- Equity
- Benefits
