Evaluation and ML Systems Engineer, AI Safety and Security Engineering
$152k - $242k • Remote • US, CA, Santa Clara
Posted 7d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
Machine Learning Engineer
About the job
NVIDIA is seeking an Evaluation/ML-Systems Engineer to join its AI Safety & Security Engineering team. This role is critical in measuring the effectiveness of AI-powered tooling designed to find, validate, and patch software vulnerabilities. You will be responsible for defining progress through benchmarks, ensuring reproducibility of results, and establishing the metrics and protocols that guide the program's conclusions. Your work will directly support security researchers and platform engineers by providing a foundation of evidence-based insights, enabling honest assessment of AI capabilities and claims.
Responsibilities
- Build benchmarking and reproducibility systems for evaluation infrastructure.
- Define metrics and protocols for measurement.
- Map every result to the code and runs that produced it for traceability.
- Ensure findings are reviewable and conclusions are traceable to maintain evidence discipline.
Requirements
- Bachelor's degree or equivalent experience with 5+ years in ML engineering or evaluation.
- Experience designing benchmarks, metrics, and statistically sound comparisons for ML systems.
- Demonstrate a careful, skeptical approach to metrics, baselines, and claims.
- Solid Python engineering skills for shared infrastructure, including experiment tracking and data pipelines.
Benefits
- Competitive salaries
- Generous benefits package
- Equity
- Health insurance
- Paid time off