New: upload your resume and get matched to AI jobs. Free to start →

Senior System Software Architect, AI and GPU Networking

Israel, Tel Aviv • Full-time

Posted 1mo ago

Job Location

Israel, Tel Aviv

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Infrastructure Engineer

About the job

NVIDIA is seeking a Senior System Software Architect specializing in AI and GPU Networking to join their AI Networking Research team. This role involves exploring technological challenges in accelerated networking and building AI data centers, researching new transport functions and semantics for optimizing AI workloads and systems, and leading architectural and development efforts across various fields including distributed AI, deep learning, data analytics, High Performance Computing (HPC), Software Defined Networking (SDN), virtualization, and storage. The architect will enhance NVIDIA's GPU Networking offerings, co-design hardware features to accelerate data movement for inference and model serving, identify and evaluate new technologies, and lead the architecture and design of new innovations like runtime systems and communication libraries.

Responsibilities

  • Enhance NVIDIA's GPU Networking offerings for accelerating AI workloads.
  • Co-design hardware features (e.g., in GPUs, DPUs, or interconnects) that accelerate data movement and enable new capabilities for inference and model serving.
  • Identify and evaluate new technologies, innovations, and partner relationships for alignment with the technology roadmap and business value.
  • Lead architecture and design of new technologies and innovations such as runtime systems and communication libraries.
  • Lead proof-of-concept development to evaluate and drive new technologies.

Requirements

  • M.Sc. or Ph.D. in Computer Science, Electrical or Computer Engineering (or equivalent experience).
  • 5+ years of industry experience in system architecture, AI systems architecture, scaling of AI, parallelism of AI frameworks, or deep learning training workloads.
  • Experience in algorithm design, system programming, computer architecture, and operating systems.
  • Experience in virtualization, networking, and storage.
  • Deep understanding of performance profiling and optimization techniques, and defining/using hardware features.
  • Strong programming and software development skills.
  • Ability to work and communicate effectively in a multi-national, multi-time-zone corporate environment.