Senior Systems Software Engineer - NV Cloud Functions
$152k - $288k • Remote • US, CA, Santa Clara
Posted 5d ago
Job Location
US, CA, Santa Clara
Tech Stack
Remote Work Policy
Fully remote
Categories
AI Infrastructure Engineer
About the job
NVIDIA Cloud Functions is seeking a motivated AI/ML Engineer with expertise in AI platform engineering at scale. The team develops and manages a serverless deployment platform designed to enable and scale AI inferencing workloads. This platform utilizes globally distributed orchestration of workloads on Kubernetes clusters backed by GPUs, operating in a cloud-agnostic manner. The role involves working with a team of innovative engineers to deliver a top-tier product for both external clients and internal NVIDIA teams, contributing to the forefront of cloud engineering paradigms for AI at scale.
Responsibilities
- Become a subject matter expert to understand user challenges and translate them into product requirements and solutions, accelerating AI model delivery and inference on the NVCF platform.
- Lead the implementation of key features, conduct user acceptance testing, load testing, and performance evaluations, focusing on customer experience, performance optimization, and platform reliability.
- Mentor and collaborate with other engineering teams on best practices for large-scale AI/ML workloads and ML reliability engineering.
- Produce reference architectures for customer use cases, integrating new NVCF features with the latest AI technologies.
- Manage and resolve customer issues, providing timely communication regarding issues and risks.
- Evaluate emerging technologies and tooling to maintain a competitive product and a forward-looking roadmap in the evolving AI-at-scale landscape.
Requirements
- Master's, PhD, or equivalent experience in Computer Science, Artificial Intelligence, Applied Math, or a related field.
- Minimum of 2 years of work experience with Python, Rust, Golang, Linux, or Bash.
- Experience in Deep Learning and Machine Learning, with expertise in AI/DL frameworks and inferencing software like SGLang, vLLM, TensorRT-LLM, or Dynamo.
- Knowledge of CPU and GPU architecture.
- Excellent interpersonal skills, including the ability to explain complex technical topics to non-experts.
- Experience in designing, implementing, and releasing AI/ML products to market, with a broad understanding of the software development lifecycle.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Eligibility for equity
- Eligibility for benefits