New: upload your resume and get matched to AI jobs. Free to start →

Senior AI Agent Test Developer, SDET

$168k - $322k • US, CA, Santa Clara • Full-time

Posted 18d ago

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Agent Engineer

About the job

NVIDIA is seeking a Senior AI Agent Test Developer to drive quality and automation for AI agents and agentic workflows on NVIDIA GPU platforms. This role involves developing comprehensive test plans and strategies to validate the integration of models, agent harnesses, and inference runtimes. The successful candidate will build advanced QA solutions to enhance test development, execution, and failure analysis, making software testing smarter and more efficient.

Responsibilities

  • Develop and utilize AI-powered tools to enhance software testing efficiency and effectiveness.
  • Improve test case generation, defect detection, flaky test analysis, regression testing, and test coverage.
  • Collaborate with product, engineering, and cross-functional teams to define test strategies based on requirements.
  • Create test plans, design and execute test cases, and report on quality status, risks, bugs, and results.
  • Conduct functional, performance, fault-injection, reliability, and regression testing for AI applications and agentic workflows.
  • Automate test cases and contribute to scalable test frameworks and agent test harnesses.
  • Manage the bug lifecycle, reproduce customer issues, and verify fixes.

Requirements

  • MS or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
  • 8+ years of QA, test automation, or software testing experience.
  • Hands-on experience developing, testing, and maintaining AI agents or their components (models, agent harnesses, inference runtimes).
  • Practical experience configuring, running, and debugging open-source models using at least one inference runtime or framework.
  • Strong QA fundamentals, test strategy, test planning, and failure analysis skills.
  • Proficiency with Unix/Linux, Python programming, and shell scripting.
  • Experience with Kubernetes, containers, CI/CD pipelines, and cloud-native systems.
  • Experience testing observability tools (e.g., Prometheus, Grafana, ELK Stack, Datadog).
  • Experience with large-scale failure testing using frameworks like KWOK or Chaos Monkey.
  • Strong communication, problem-solving skills, and curiosity for complex technology.

Benefits

  • Equity
  • Benefits