d-Matrix

d-Matrix is seeking a Senior Staff Inference Performance Engineer to join their Inference Cloud Engineering team. This role is responsible for the end-to-end performance of workloads deployed on d-Matrix's inference services, ensuring they perform at least as well as on bare metal. The engineer will diagnose and isolate performance issues across the full serving path, from orchestration to inference internals, and will be responsible for either fixing problems directly or handing them off to the appropriate owning team with clear evidence. The role involves assessing scalability, defining node requirements for optimal deployment, and building telemetry and benchmarks to support these efforts. The ideal candidate will mentor other engineers in a profiling-first methodology.

$175k - $265k

d-Matrix is at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We foster a culture of respect, collaboration, humility, and direct communication, valuing diverse perspectives to create better solutions. We are seeking passionate, execution-driven individuals ready to tackle challenges and shape the future of AI. The Inference Cloud Engineering team is responsible for the deployment and orchestration technology behind d-Matrix’s inference services, including an internal cloud for model testing and a customer-facing cloud with self-service inference endpoints. This role will own the end-to-end testing and release process for this critical software, ensuring features are proven, releases are predictable, and rollbacks are safe, even with scarce and shared hardware resources.

$155k - $235k

d-Matrix is seeking a Principal Test Automation Engineer to define and build AI-enabled automation across the software development lifecycle, from build and CI through testing and release. This role involves setting technical direction for AI-enabled workflow automation, building foundational components like agent harnesses and integrations, and developing evaluation methods to ensure automation effectiveness. You will work hands-on, shipping critical components and collaborating with other engineers to raise the bar for AI adoption in daily engineering tasks. The ideal candidate will have extensive production software engineering experience, strong Python skills, and experience shipping AI-enabled tools in production.

$195k - $285k

d-Matrix is at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We foster a culture of respect, collaboration, humility, and direct communication, valuing diverse perspectives to create better solutions. We are seeking passionate individuals driven by execution to join us in shaping the future of AI. As a Staff-level individual contributor on the Software Infrastructure team, you will drive the automation for our CI/CD and release pipeline. This involves diagnosing and fixing pipeline failures, such as identifying real regressions, flaky hardware, or infrastructure issues, and pinpointing the exact merge that caused overnight test failures. You will blend AI techniques with traditional software automation to build highly reliable systems and architect compute and storage solutions across cloud and on-prem environments. Your role will involve partnering with various teams to develop and spread best practices, reducing developer toil and accelerating development velocity.

$155k - $235k

d-Matrix is seeking a Sr Staff Site Reliability Engineer to join their AI Infrastructure team. This role is crucial for owning the infrastructure layer that powers all engineering teams and customers, encompassing colocation facilities, on-premises GPU clusters, cloud environments, and platform services. You will be responsible for reliability, automation, and observability across these diverse environments, managing systems end-to-end from provisioning to incident response. This is a hands-on position focused on building and operating real infrastructure, collaborating with hardware and software teams on CI/CD, QA, and HPC workloads, and supporting customer-facing deployments.

$175k - $265k

D-Matrix Frontier Group is at the leading edge of LLM inference on heterogeneous hardware, working across the full stack from use case identification and kernel optimization to building proof-of-concept systems. We build the tools, runtimes, and frameworks that enable frontier AI models to run efficiently and cost-effectively on diverse hardware, including D-Matrix silicon, CPUs, GPUs, and custom accelerators. This applied research and engineering team moves fast, ships real systems, and collaborates directly with product and hardware teams to shape the roadmap. We are seeking end-to-end inference engineers who are comfortable taking a novel research idea to a deployed, optimized system, working at every layer of the inference stack from kernel-level optimization to distributed orchestration and high-level serving APIs.

$195k - $285k

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration, valuing humility and direct communication. We are seeking individuals passionate about tackling challenges and driven by execution to help shape the endless possibilities of AI.

$190k - $300k

d-Matrix is at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We are seeking passionate individuals driven by execution to join our inclusive and collaborative team. This role is for a Principal System Software Engineer focused on AI Inference Execution, contributing to the productization of our AI compute engine's software stack. You will be instrumental in developing, enhancing, and maintaining next-generation AI deployment software, leveraging your expertise in full-stack toolchains and hardware-software co-design to optimize performance and scale deliverables within tight development windows.

$195k - $285k

At d-Matrix, we are at the forefront of software and hardware innovation, unleashing the potential of generative AI. We are seeking passionate individuals driven by execution to join our inclusive and collaborative team. Together, we can shape the endless possibilities of AI.

$195k - $285k

At d-Matrix, we are at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We foster a culture of respect, collaboration, humility, and direct communication, valuing diverse perspectives to create better solutions. We are seeking passionate, execution-driven individuals ready to tackle challenges and shape the future possibilities of AI.

$195k - $285k

d-Matrix is seeking a Senior Staff ML Researcher to join our Algorithms team and develop new methods for running large language models efficiently on our DNN accelerators. This is a hands-on research role at the intersection of machine learning, applied mathematics, numerical computing, and AI hardware. You will invent, evaluate, and implement algorithmic techniques that improve LLM inference performance while preserving model quality, with a focus on challenges such as numerical precision, model compression, memory efficiency, and efficient execution on accelerator hardware. You will work closely with mathematicians, ML researchers, ML engineers, compiler engineers, and hardware architects to translate research ideas into practical solutions for cutting-edge generative AI workloads.

$175k - $265k

At d-Matrix, we are at the forefront of software and hardware innovation, focused on unleashing the potential of generative AI. We foster a culture of respect, collaboration, humility, and direct communication, valuing diverse perspectives to create better solutions. We are seeking passionate individuals driven by execution to join our inclusive team and help shape the endless possibilities of AI.

At d-Matrix, we are at the forefront of software and hardware innovation, focused on unleashing the potential of generative AI. We are seeking passionate individuals driven by execution to join our inclusive and collaborative team. Together, we can shape the endless possibilities of AI.