NUMA Jobs

d-Matrix is seeking a Senior Staff Inference Performance Engineer to join their Inference Cloud Engineering team. This role is responsible for the end-to-end performance of workloads deployed on d-Matrix's inference services, ensuring they perform at least as well as on bare metal. The engineer will diagnose and isolate performance issues across the full serving path, from orchestration to inference internals, and will be responsible for either fixing problems directly or handing them off to the appropriate owning team with clear evidence. The role involves assessing scalability, defining node requirements for optimal deployment, and building telemetry and benchmarks to support these efforts. The ideal candidate will mentor other engineers in a profiling-first methodology.

$175k - $265k