New: upload your resume and get matched to AI jobs. Free to start →

This job has closed on November 22, 2026.

Jobgether is no longer taking applications for it. Browse AI Engineer jobs.

Closed

Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)

$220k - $270k • US • Full-time

Posted 5d ago

Job Location

US

Tech Stack

Remote Work Policy

On-site

Employment Type

Full-time

Categories

AI Engineer

About the job

Accountabilities:

  • Collaborate with chip architects to translate architectural questions into structured modeling studies, defining assumptions, alternatives, performance metrics, and recommendations.
  • Conduct architectural trade-off analyses across compute engines, memory capacity and bandwidth, dataflow, DMA, command processing, on-chip interconnects, and chip-to-chip communication.
  • Evaluate different hardware configurations and identify opportunities to improve performance while respecting power, area, system, and implementation constraints.
  • Analyze representative AI inference workloads across prefill and decode phases, different batch sizes and context lengths, and dense and mixture-of-experts (MoE) models.
  • Identify performance bottlenecks affecting latency, throughput, and hardware utilization, translating findings into practical architectural improvements.
  • Develop and enhance analytical, transaction-level, and cycle-level performance models, selecting the appropriate level of detail to balance accuracy and development speed.
  • Build, maintain, and extend reusable models within a native Rust simulation framework.
  • Validate and correlate model predictions against RTL simulations, emulation results, and silicon measurements as they become available.
  • Maintain regression coverage and clear documentation of modeling assumptions, limitations, discrepancies, and results.
  • Communicate findings effectively to architecture and engineering teams, providing ongoing recommendations as workloads, specifications, and design decisions evolve.
  • Take primary responsibility for modeling a next-generation chip while contributing to the continuous improvement of the team's modeling infrastructure.

Requirements:

  • At least 5 years of professional experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, GPUs, or similar hardware platforms.
  • Proven experience using performance models to influence architectural decisions, identify bottlenecks, evaluate design alternatives, and support recommendations with quantitative analysis.
  • Strong understanding of computer architecture fundamentals, including pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnect architectures.
  • Hands-on experience developing analytical, transaction-level, or cycle-level performance models, including first-order estimates to validate and interpret simulation results.
  • Ability to work effectively with incomplete specifications, document assumptions, and balance modeling accuracy with rapid iteration.
  • Strong programming skills in Rust, or expert-level C/C++ proficiency combined with a willingness to work extensively in Rust.
  • Proficiency in Python for workload analysis, experimentation, data processing, and performance visualization.
  • Ability to read and interpret SystemVerilog RTL and verification results, reconcile implementation details with architectural specifications, and calibrate models as hardware designs mature.
  • Excellent analytical, problem-solving, and communication skills, with the ability to explain performance results, assess confidence levels, and recommend clear next steps.
  • Ability to collaborate closely with multidisciplinary engineering teams and take ownership of complex technical projects.
  • Experience with LLM inference is highly desirable, including attention mechanisms, KV caches, quantization, mixture-of-experts workloads, and multi-chip parallelism.
  • Familiarity with the relationship between workload behavior, software execution strategies, and hardware performance is a strong advantage.
  • Candidates with experience exceeding the stated requirements may be considered for Principal-level responsibilities, with scope and expectations adjusted according to seniority and expertise.
  • Applicants must currently be authorized to work in the United States. New visa sponsorship is not available; however, H-1B transfers may be facilitated for eligible candidates.

Benefits:

  • Competitive base salary:
  • Senior: $220,000–$270,000 per year.
  • Principal: $270,000–$350,000 per year.
  • Competitive equity opportunities as part of the overall compensation package.
  • Flexibility to consider compensation above the stated ranges for candidates with exceptional expertise, experience, or specialized qualifications.
  • Fully company-paid medical, dental, and vision insurance for employees and their dependents.
  • Company-paid life and disability insurance, with additional voluntary coverage options.
  • Access to supplemental hospital, critical illness, and accident insurance.
  • Unlimited paid time off, with an emphasis on maintaining a healthy work-life balance and taking time to recharge.
  • 13 paid company holidays annually.
  • Remote-first working environment, offering flexibility to work from anywhere in the United States.
  • Company-provided computer and home office setup.
  • 401(k) retirement plan with company matching, available from the first day of employment.
  • Opportunity to work on next-generation AI inference silicon and directly influence major architectural decisions before RTL implementation.
  • Close collaboration with experienced engineers and architects working on advanced AI hardware systems.
  • Opportunity to contribute to the development of hardware infrastructure designed to serve increasingly large and sophisticated AI models.