Senior AI Performance Engineer
Salary not listed • Austin, Texas, United States • Full-time
Posted 22d ago
No salary is listed. Many US states require employers to post a pay range, so ask about pay early.
About the job
As a Senior AI Performance Engineer, you will analyze and optimize AI training and inference workloads across large-scale distributed systems. Your work will connect compute, memory, communication, and software behavior, owning complex performance investigations from problem definition through validation. You will translate profiling, benchmarking, and modeling results into actionable improvements for engineers. This role offers broad scope across hardware, software, networking, and system architecture, contributing to Graphcore's delivery of efficient and reliable AI systems for large-scale deployment.
Responsibilities
- Analyze and optimize AI training and inference workloads on large-scale distributed systems.
- Connect compute, memory, communication, and software behavior to identify performance bottlenecks.
- Own complex performance investigations from problem definition to validation.
- Translate profiling, benchmarking, and modeling results into engineer-actionable improvements.
- Design benchmarks and investigate system bottlenecks.
- Optimize distributed communication software using technologies like MPI, NCCL, UCX, and RDMA.
- Coordinate improvements across teams and validate impact with performance data.
Requirements
- Strong experience profiling and optimizing AI, machine learning, or high-performance computing workloads.
- Experience with distributed systems and communication libraries (e.g., MPI, NCCL, UCX, libfabric).
- Strong C++ and Python skills, including experience with reliable tools or performance-sensitive software.
- Deep understanding of compute, memory, and communication behavior in large-scale systems.
- Ability to own complex technical work and coordinate improvements across teams.
- Familiarity with MLPerf, accelerated architectures, ML frameworks, or high-performance interconnects.
Benefits
- Competitive compensation
- Medical, dental, and vision coverage
- Mental health, wellness, and employee assistance resources
- Retirement savings benefits and company contributions
- Paid vacation, sick time, company holidays, and parental or family leave
- Life insurance and short-term or long-term disability coverage
- Flexible working hours
- Hybrid working arrangements
- Professional-development resources and learning programs
- Office amenities and team-led activities