Hardware/Software Co-Design Engineer, Inference
$192k - $278k • Sunnyvale, CA, USA • Full-time
Posted 16d ago
Job Location
Sunnyvale, CA, USA
Tech Stack
Remote Work Policy
On-site
Employment Type
Full-time
Categories
AI Infrastructure Engineer
About the job
This role focuses on shaping the future of AI/ML hardware acceleration by driving cutting-edge TPU (Tensor Processing Unit) technology. You will be part of a team developing custom silicon solutions that power Google's AI/ML applications and future TPUs. The position involves bridging the gap between model architecture innovation and next-generation hardware design, operating cross-functionally across AI research and engineering to influence the architectural roadmap for machine learning serving and training. You will contribute to integrating ML research, including the training and serving of massive foundation models, with advanced silicon architectures to deliver high-performance, power-efficient accelerators.
Responsibilities
- Define and optimize the hardware/software stack for performant training and serving of large ML models.
- Collaborate with research and modeling teams to innovate on model architectures, focusing on scaling, quality, and hardware performance impact.
- Develop configurable architectural simulators and cycle-accurate performance models to quantify microarchitectural optimizations and evaluate architectural decisions.
- Conduct system-level performance analysis across distributed ML systems, innovating methodologies to balance compute, memory bandwidth, and inter-chip network requirements.
- Engage with hardware design, compiler development, and ML research partners to transition architectural innovations from concept to production.
Requirements
- Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or equivalent practical experience.
- 10 years of experience in computer architecture, chip architecture, or hardware-software co-design.
- Experience developing systems for performance modeling, simulation, or system analysis.
- Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture (preferred).
- Experience architecting hardware solutions or performance optimizations for ML training and inference (preferred).
- Experience with deep learning frameworks such as TensorFlow or PyTorch (preferred).
- Deep understanding of ML trends, business drivers, and the software ecosystem (preferred).
- Ability to engage and collaborate with hardware designers, software architects, and ML researchers (preferred).
Benefits
- 20% bonus target
- Equity
- Benefits
