Principal Software Engineer, Kernels

About the job

Responsibilities

• Develop, enhance, and maintain software kernels for next-generation AI hardware.
• Build software kernels for HW architectures, mapping algorithms and computational graphs to underlying architectures.
• Optimize hardware-software co-design aspects and build/scale software deliverables within tight development windows.
• Collaborate with compiler experts to build compiler infrastructure.
• Work closely with software (ML, systems) and hardware (mixed signal, DSP, CPU) experts.

Requirements

• MS in computer engineering, math, physics, or related with 12+ years of industry experience, OR PhD with 7+ years of industry experience.
• Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals.
• Proficient in C/C++ and Python development in Linux environments.
• Experience implementing algorithms in high-level languages (C/C++, Python).
• Experience implementing algorithms for specialized hardware (FPGAs, DSPs, GPUs, AI accelerators) using libraries like CUDA.
• Experience implementing operators for ML workloads (GEMMs, Convolutions, BLAS, SIMD operators).
• Experience with development for embedded SIMD vector processors (e.g., Tensilica).
• Self-motivated team player with ownership and leadership skills.
• Experience with ML frameworks such as TensorFlow and/or PyTorch (preferred).
• Experience with ML compilers and algorithms (e.g., MLIR, LLVM, TVM, Glow) (preferred).
• Experience with a deep learning framework and ML models for CV, NLP, or recommendation (preferred).
• Experience at a cloud provider or AI compute/subsystem company (preferred).