Distinguished Engineer, AI Infrastructure
Cupertino, California, United States; Seattle, Washington, United States
Posted 1mo ago
Job Location
Cupertino, California, United States; Seattle, Washington, United States
Tech Stack
Remote Work Policy
On-site
Categories
AI Infrastructure Engineer
About the job
We are seeking a Distinguished Engineer to provide technical leadership in building and evolving next-generation AI infrastructure at Apple. In this role, you will shape the architecture and long-term technical strategy for large-scale training and inference systems, working at the intersection of AI research, systems, and cloud infrastructure. Your work will directly influence how frontier and production models are trained, deployed, and scaled across diverse accelerator platforms.
Responsibilities
Set the technical vision and define the roadmap for frontier AI infrastructure spanning a multi-cloud heterogeneous compute fleet
Design and build distributed systems for job scheduling, cluster management, and cost governance
Partner closely with ML researchers and engineers to scale and optimize end-to-end performance of AI training and inference workloads
Establish connections with cross-functional partners, collaborating with teams across cloud infrastructure, business operations, finance, and engineering
Minimum qualifications
Bachelor’s degree in Computer Science, relevant technical field, or equivalent practical experience
15 years of experience designing and building very large-scale distributed systems
Proficiency in at least 1 backend language (e.g., Python, C++, Go, Rust)
Proficiency in cloud-native architectures and compute orchestration platforms (e.g., Kubernetes)
Hands-on experience working with ML accelerators such as GPUs and TPUs
Track record of mentoring senior engineers and setting long-term architectural vision across orgs
Preferred qualifications
Master’s degree or PhD in Computer Science or related technical fields
Experience in running distributed training and/or inference workloads in production
Expertise in ML systems performance profiling, debugging, and optimization
Expertise in deep learning frameworks (e.g., PyTorch, JAX) and their underlying architectures
