AI Computing Software Development Intern - 2027
Salary not listed • Taiwan, Taipei • Internship
Posted 1mo ago
Job Location
Taiwan, Taipei
Also open in China, Shanghai
Tech Stack
Remote Work Policy
On-site
Employment Type
Internship
Categories
LLM Engineer
About the job
NVIDIA is seeking skilled interns in artificial intelligence computing solutions to join our AI Compute team in Taiwan. This internship offers the opportunity to work on advanced AI systems, contributing to the development of technologies for Large Language Models, Recommender Systems, and Generative AI, while pushing the limits of GPU performance for AI inference. Interns will focus on specialized tracks within TensorRT-LLM for inference optimization or TensorRT Compiler for graph optimization.
Responsibilities
- Build and enhance high-performance LLM inference pipelines on key LLM models.
- Analyze and optimize LLM model execution, scalability, and memory usage.
- Collaborate across framework and research teams to deliver efficient multi-GPU model serving for Agentic AI workloads.
- Work on the TensorRT compiler backend to improve graph transformations and code generation for NVIDIA GPUs.
- Develop compiler optimization passes, refine operator fusion, and optimize memory usage.
- Collaborate with CUDA and hardware architecture teams to accelerate Deep Learning inference computations.
Requirements
- Currently pursuing a B.S., M.S., Ph.D., or equivalent in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or related fields.
- Excellent problem-solving ability, curiosity for modern AI systems, and passion for GPU computing and deep learning software performance.
- For TensorRT-LLM: Strong Python programming and experience with PyTorch; solid understanding of underlying LLM inference operations and GPU acceleration.
- For TensorRT Compiler: Proficient in C++, with experience in compiler or performance optimization.