ONNX Runtime Jobs

Deepgram is seeking an Applied ML Engineer to focus on deploying their advanced speech models to a variety of edge devices and non-NVIDIA accelerators. This role involves adapting existing models to run efficiently within diverse hardware constraints, including different inference runtimes and operator sets. You will be responsible for optimizing models through techniques like quantization and precision adjustments, validating performance on real hardware, and building robust deployment pipelines for edge targets. This is a hands-on engineering position, distinct from research or cloud-focused roles, aimed at ensuring Deepgram's cutting-edge voice AI can be deployed effectively across a wide range of customer hardware.

$155k - $245k

Parallel Wireless is seeking experienced wireless algorithm experts to research and design advanced cellular communication algorithms for 5G and beyond products. This role will leverage neural networks and machine learning techniques to reimagine mobile networks with innovative, energy-efficient Open RAN solutions. The ideal candidate will contribute to the future of telecommunications by driving innovation through green and sustainable networks.

D-Matrix Frontier Group is at the leading edge of LLM inference on heterogeneous hardware, working across the full stack from use case identification and kernel optimization to building proof-of-concept systems. We build the tools, runtimes, and frameworks that enable frontier AI models to run efficiently and cost-effectively on diverse hardware, including D-Matrix silicon, CPUs, GPUs, and custom accelerators. This applied research and engineering team moves fast, ships real systems, and collaborates directly with product and hardware teams to shape the roadmap. We are seeking end-to-end inference engineers who are comfortable taking a novel research idea to a deployed, optimized system, working at every layer of the inference stack from kernel-level optimization to distributed orchestration and high-level serving APIs.

$195k - $285k

d-Matrix is at the forefront of software and hardware innovation, aiming to unleash the potential of generative AI. We are seeking passionate individuals driven by execution to join our inclusive and collaborative team. This role is for a Principal System Software Engineer focused on AI Inference Execution, contributing to the productization of our AI compute engine's software stack. You will be instrumental in developing, enhancing, and maintaining next-generation AI deployment software, leveraging your expertise in full-stack toolchains and hardware-software co-design to optimize performance and scale deliverables within tight development windows.

$195k - $285k

Deepgram is seeking an Embedded AI Engineer to work on optimizing their speech models for a wide range of hardware, including non-NVIDIA accelerators, embedded SoCs, mobile processors, and specialized devices with tight resource constraints. This role operates at the lowest layer of the edge stack, focusing on writing and optimizing custom kernels and operators, collapsing models onto device-specific execution units, and performing target-side quantization and assembly-level tuning. The engineer will collaborate with Applied ML Engineers to ensure Deepgram's models can run efficiently on new hardware platforms, making them viable for edge deployment. This position is ideal for senior embedded engineers with a passion for AI or staff-level engineers looking to shape the future of on-device AI model deployment.

$219k - $274k