C++ Jobs

We are seeking a Staff Engineer to build and maintain the production systems that power our AI-enabled product capabilities. This role bridges ML systems, platform engineering, and site reliability engineering, focusing on moving machine-learning models and agentic workflows from prototypes to secure, observable, and continuously deployable production systems. You will partner with various teams to create a streamlined path from experimentation to production and ensure the ongoing performance and evolution of these systems.

NVIDIA is seeking a Senior Software Engineer to specialize in Deep Learning Inference. This role involves designing, building, and optimizing GPU-accelerated software for AI applications, focusing on high-performance deep learning frameworks like SGLang and vLLM for efficient large-scale model serving and inference. You will contribute to improving these platforms, enabling the smooth deployment of advanced language models and working with the deep learning community to implement and release the latest algorithms. The work will concentrate on enhancing the performance of state-of-the-art LLM and Generative AI models across various NVIDIA accelerators, utilizing open-source tools and kernels for optimization.

$184k - $357k

Anthropic

Anthropic's inference engine is the core software responsible for managing the entire token path, from request batching and model distribution across chips to memory management and coordinating forward passes. This in-house system serves Claude to millions of users and supports research workloads across all accelerator platforms. The role involves building and optimizing this system at scale, focusing on improving throughput, cost, reliability, and latency. It requires a deep understanding of hardware and bandwidth metrics, with the ability to quickly model performance bottlenecks. This is a highly technical and impactful position for engineers who enjoy working with accelerator programming, high-performance host-device systems, and large-scale distributed systems. Familiarity with transformer architecture is beneficial.

$350k - $850k

Parallel Wireless is seeking a hands-on technical leader to build and operate a secure local large-language-model (LLM) platform. This platform will enable engineering and business teams to leverage generative AI with proprietary company data, including source code, product documentation, and technical standards, all within a secure, company-controlled environment. This senior individual contributor role involves applied LLM engineering, platform architecture, data pipelines, security, and production operations. You will transform prototypes into a dependable internal capability by selecting and optimizing open-weight models, building permission-aware retrieval systems, creating reusable APIs and tools, integrating with existing workflows, and establishing metrics for quality, safety, latency, capacity, and business value. The role emphasizes building a trustworthy enterprise LLM solution that includes robust source grounding, access controls, repeatable evaluation, observable services, and a sustainable operating model.

Parallel Wireless is seeking a skilled wireless systems engineer to lead the development of a multi-RAT digital twin for their Open RAN solution. This role involves executing production RAN software within a closed-loop simulation environment, enabling engineering teams to design, evaluate, and compare features for LTE, 5G NR, and 2G without the need for physical radio setups. The position is a senior individual contributor role at the intersection of wireless systems, simulation, production software, and AI/ML, focused on evolving an existing simulator into a scalable platform for feature development, testing, and optimization.

At Suki, we are building technology that automates clinical documentation in real-time using cutting-edge AI, significantly reducing the administrative burden on clinicians. Our platform powers voice-enabled healthcare experiences across various platforms, aiming to make clinicians' lives better. The Machine Learning team is central to this mission, driving innovation and enhancing our AI capabilities. You will leverage your NLP expertise to improve our computational infrastructure, technical approaches, and algorithms. Working directly on the platform, you'll collaborate with cross-functional teams to tackle NLP challenges and scale our services. This role involves managing and curating large datasets, monitoring system performance, and staying abreast of the latest advancements in NLP and Generative AI to maintain our competitive edge.

$225k - $250k

NVIDIA is seeking software engineers for the CUDA Tile team to work on a new tile-based programming model for their GPUs. This role involves designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels across various NVIDIA GPU architectures. The work includes defining public APIs, crafting compiler and optimization techniques, and general software engineering tasks. NVIDIA is a leading technology company transforming computer graphics, PC gaming, and accelerated computing, now focusing on AI to define the next era of computing.

$152k - $242k

NVIDIA is seeking a Principal EDA R&D Engineer to lead the research, architecture, and development of next-generation hardware formal verification tools. This role involves pioneering advancements in core formal verification engines, enhanced by Agentic AI frameworks. You will craft collaborative, autonomous AI agent networks to extend formal tools, enabling them to automatically break down large builds, coordinate solver strategies, synthesize complex properties, and debug execution traces at an unprecedented scale. The position demands deep algorithmic knowledge, rigorous industrial software engineering, and a proven track record of delivering production-grade EDA tools.

$232k - $368k

Fireworks is seeking new graduates for its Member of Technical Staff role, offering a unique opportunity to work on real AI systems in production from day one. As an MTS, you will write and ship code for one of the world's busiest inference platforms, serving hundreds of models at massive scale. The company matches new hires to teams based on their strengths and interests, with potential work spanning inference, model training, distributed systems, cloud infrastructure, developer platforms, or full-stack application engineering. You will be paired with a senior engineer mentor and undergo a structured ramp-up, starting with well-scoped problems and progressing to owning features and systems independently. Fireworks emphasizes a fast-paced environment with a high bar and a commitment to employee development.

$160k - $180k

Crusoe is seeking a Staff Applied AI Inference Engineer to accelerate the abundance of energy and intelligence by optimizing large language models for production environments. This role involves owning the inference stack end-to-end, focusing on profiling, applying modern optimization techniques, and deep dives into serving code to enhance speed, reduce cost, and improve reliability. The work is hands-on, involving coding, profiling, and low-level optimization, with a customer-facing component to tailor deployments to specific needs and ensure performance gains are realized in real-world scenarios. You will transition workloads from proof-of-concept to fully monitored production services, making this a core systems and performance engineering role on demanding AI workloads.

$215k - $260k

Fireworks is seeking PhD graduates in Computer Science, Computer Engineering, or Electrical Engineering to join their Systems Infrastructure team. This role is for individuals who want to apply their research ideas to real-world, large-scale AI infrastructure. You will be responsible for designing and building the core systems that power Fireworks' AI platform, including schedulers, storage systems, and networks, ensuring efficient utilization of hardware and low inference latency. You will work on challenging problems related to compute placement, efficient data movement, and high-performance networking for AI workloads, with the opportunity to see your work ship in a production environment.

$200k - $230k

Fireworks is seeking a Member of Technical Staff on the Research team, designed for individuals completing their PhD who want to see their work deployed in production. This role involves pushing the boundaries of generative AI, advancing LLMs and multimodal systems through foundational research. Your work will focus on enhancing model efficiency, accuracy, and scalability, directly contributing to our high-performance AI infrastructure. You will be paired with a senior researcher for mentorship and tackle a real research problem from day one, collaborating with experts in deep learning, distributed systems, and optimization. The goal is to see the models you help create deployed by leading companies, often within weeks.

$200k - $300k

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a unique opportunity to help build a generational company at an inflection point, with strong product-market fit and investor support. The team operates with intensity, ownership, and a commitment to excellence, valuing decisiveness, simplicity, and continuous improvement. If you are driven to do your best work alongside like-minded individuals, Harvey is the place to be.

$231k - $340k

Moveworks is seeking a Machine Learning Engineer to develop cutting-edge ML infrastructure for building and serving LLMs. This role is pivotal in constructing, optimizing, and scaling end-to-end machine learning systems, encompassing distributed training and inference pipelines for large language models, model evaluation and monitoring frameworks, and LLM latency optimization. The frameworks developed will serve as a robust foundation for hundreds of ML and NLP models in production, impacting millions of enterprise employees. You will address challenges in service scalability and core algorithm optimization, working closely with machine learning, data infrastructure, and core skill teams. Your contributions will significantly influence customer AI experiences and the long-term scalability of our core AI product.

Eventual is building data curation for Physical AI, processing petabyte-scale video and sensor data to extract crucial signals for training frontier AI models. The company's mission is to empower Physical AI and robotics teams to instantly find, curate, and stream the data they need. As a Software Engineer on the Data Systems team, you will build key capabilities for a high-throughput data engine over petabytes of video, lidar, and telemetry data, working directly on the architecture for real-time indexing, distributed storage/compute, and efficient dataloading to GPUs. This role offers high ownership across the stack in an agile, fast-paced startup environment.

$150k - $200k

Parallel Wireless is seeking a driven PHY SW Engineer to join their R&D team. This role will focus on developing advanced, carrier-grade 4G cellular communication solutions, emphasizing performance, reliability, and AI-driven development. The engineer will contribute to building the software behind next-generation cellular networks and shaping the future of telecommunications through innovative and sustainable solutions.

We are seeking a Senior Hardware Architect to focus on Reliability, Availability, and Serviceability (RAS) for our Tegra System-on-Chips (SoCs). This role offers the chance to contribute to the AI revolution by defining resilient computing platforms for datacenters, autonomous vehicles, and edge systems. You will be instrumental in defining, driving, and delivering RAS hardware architecture across advanced CPUs and SoCs, guiding features from initial concepts through design, verification, validation, and production readiness. This is an opportunity to make a significant impact in a technology-driven company, working with world-class teams to enhance system resiliency, observability, debuggability, and serviceability.

NVIDIA is seeking software engineers for the CUDA Tile team to work on a new tile-based programming model for GPUs. This role involves designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels across various NVIDIA GPU architectures. The work includes defining public APIs, crafting compiler and optimization techniques, and general software engineering tasks. NVIDIA is a leading technology company transforming computer graphics, PC gaming, and accelerated computing, now focusing on AI to define the next era of computing.

$152k - $242k

Labelbox is seeking a Forward Deployed Engineer to design, develop, and operationalize reinforcement learning (RL) environments. This role involves building sandboxed, reproducible execution environments for AI agents during training and evaluation, such as terminal-based task benchmarks, browser environments, and tool-augmented workspaces. You will write production-quality infrastructure code, integrate with open-source RL tooling, and collaborate with the data operations team to ensure environments are robust and observable. While not a research role, a deep understanding of how RL training loops consume environments and identify bottlenecks is essential.

$140k - $200k

NVIDIA is seeking a motivated system software engineer with deep understanding of device drivers and strong C/C++ skills to work on the CUDA Driver. This role is integral to a team that delivers features and improvements to realize the full potential of NVIDIA hardware for a wide range of computational workloads, including deep learning, scientific computation, data science, self-driving cars, video games, and virtual reality. You will use your design abilities, coding expertise, and creativity to craft elegant solutions to exciting problems and shape the future direction of CUDA by collaborating with peers across NVIDIA.

$152k - $288k