Software Engineer, AI Inference
San Mateo, CA
Posted 3mo ago
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
Skild AI is seeking a Software Engineer to join their team and work on deploying cutting-edge AI models for embodied systems. This role focuses on optimizing AI inference processes for models ranging from lightweight to billion-parameter scale, ensuring robots operate efficiently and intelligently in real-world scenarios. You will bridge the gap between systems and machine learning, directly enhancing AI model power and adaptability by maintaining consistent performance under varying compute and hardware constraints.
Responsibilities
- Develop and optimize runtime AI inference pipelines for robotic deployment.
- Build infrastructure, frameworks, and tooling for reliable model integration and analysis.
- Formulate specialized optimization solutions for diverse inference paradigms and scenarios.
- Adapt optimization solutions to various compute, hardware, and networking constraints.
Requirements
- BS, MS or higher degree in Computer Science, Robotics, Engineering, or equivalent practical experience.
- Minimum of 3 years of industry experience.
- Proficiency in low-level systems languages (C, C++, Rust, Go) and Python.
- Experience with at least one deep learning library (PyTorch, TensorFlow, JAX).
- Deep understanding of low-level systems concepts (multithreading, networking, embedded systems, memory management).
- Experience with CUDA.
- Deep understanding of state-of-the-art machine learning techniques and models.
- Experience optimizing various machine learning architectures.
- Experience with machine learning compilers.
- Experience optimizing model inference for robotic systems deployment.