Senior AI Engineering Jobs

Together AI

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. The AI Infrastructure team is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.

$200k - $280k

Together AI

Together AI runs one of the largest GPU fleets globally, and the Infra Agent Systems team is responsible for developing the software that powers and automates this infrastructure. The team builds production AI agents designed to diagnose hardware failures, investigate incidents, correlate signals across the fleet, and automate operational workflows. Alongside these agents, they are building the core platform, which includes knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling. This role offers the unique opportunity to work at the intersection of AI agents, distributed systems, infrastructure, and automation, tackling complex engineering challenges with significant real-world impact.

$250k - $300k

Together AI

Together AI is seeking a full-stack engineer to join their Product Engineering team. This role focuses on enhancing the developer experience across their AI platform, including surfaces like Playground, Model Garden, and Fine-Tuning. The ideal candidate is motivated by shipping impactful features that users value, working across the entire product lifecycle from data models to user interfaces. This is a high-ownership position on a fast-moving team where individual contributions are highly visible and directly influence product direction.

$160k - $230k

Together AI

Together is seeking a Senior Product Engineer to join their central Product Engineering team, working closely with the Commerce engineering team. You will be responsible for the product UI for Together AI's critical user flows, including enterprise spend controls, governance, usage-based pricing, metering dashboards, payment management, and enterprise contract interfaces. This role requires a hands-on individual who can efficiently break down ambiguous tasks, deliver improvements quickly, and make pragmatic decisions to drive customer and revenue impact. You will collaborate with product, design, and backend engineers, leveraging strong product judgment to make UX decisions within established patterns.

$160k - $230k

Together AI

At Together AI, you will be responsible for the systems and tooling that enable engineers to ship code quickly and reliably. This includes CI/CD pipelines, release infrastructure, local development environments, and testing systems. This is a build-heavy, high-leverage role where you will drive large projects end-to-end, focusing on building the infrastructure that makes manual effort unnecessary and allows engineers to concentrate on product development.

$180k - $250k

Together AI

The Model Shaping team at Together AI focuses on tailoring open foundation models for downstream applications, building services that help machine learning developers select and improve models with domain-specific data. We also develop novel methods for efficient model training and evaluation, drawing from machine learning, natural language processing, and ML systems. As a Research Engineer on the Scaling Team, you will translate cutting-edge research in efficient foundation model training into robust, high-performance systems. You will optimize Together's training infrastructure, identify performance bottlenecks, and implement state-of-the-art techniques in production environments. Your work will directly influence the fine-tuning experience for Together's customers. You will integrate newly released open-source models onto the platform, ensuring efficient and reliable training across diverse workloads. Collaborating with Research Scientists, you will build experimental infrastructure to accelerate research and deploy validated ideas at scale.

$200k - $290k

Together AI

As a Customer Success Engineer at Together AI, you will be the named technical owner for one of our most strategic customer relationships. You will serve as the primary technical point of contact across all infrastructure domains, including compute, networking, storage, and facilities, ensuring the flawless delivery and operational health of large-scale GPU deployments. This role is crucial for driving both customer success and company growth by combining deep infrastructure expertise with high-stakes customer partnerships.

$260k - $290k

Together AI

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware and enables state-of-the-art ML practitioners with self-serve AI cloud services. This platform serves both internal StaaS products and external cloud customers across dozens of data centers worldwide.

$160k - $230k

Together AI

Together AI is building the Inference Platform to deliver advanced generative AI models, powering multi-tenant serverless workloads and dedicated endpoints. This platform enables developers, enterprises, and researchers to utilize the latest LLMs and multimodal models at scale. The role focuses on optimizing latency and maximizing the utilization of tens of thousands of GPUs. You will collaborate directly with research teams to productionize frontier models and engage with the open-source community, contributing to and leveraging projects like SGLang and vLLM to enhance inference performance and efficiency.

$200k - $290k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering production-grade, real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Staff ML Engineer to lead the model serving layer for voice workloads. This role involves hands-on optimization of inference engines and models, profiling GPU utilization, designing batching strategies for streaming audio, and ensuring rapid deployment of new model architectures from research to production. This is a foundational hire on a small, high-impact team, addressing the unique challenges of voice inference such as streaming audio, tokenization, and real-time latency budgets, and shaping the future of voice model serving.

$220k - $280k

Together AI

Together AI is building the best inference infrastructure for voice applications, powering real-time voice agents and applications with best-in-class latency and reliability for speech-to-text and text-to-speech models. We are seeking a Senior ML Engineer to lead the model serving layer for voice workloads. You will optimize inference engines like TRT-LLM and SGLang to serve models such as Whisper, Parakeet, Orpheus, and Kokoro, focusing on pushing latency and throughput boundaries. This role involves profiling GPU utilization, designing batching strategies for streaming audio, and accelerating the transition of new model architectures from research to production. As a foundational hire on a small, high-impact team, you will address the unique challenges of voice inference, including streaming audio, real-time latency, and tokenization, shaping how Together serves voice models as the industry moves towards end-to-end speech-to-speech systems.

$200k - $260k

Isomorphic Labs is seeking a Staff Software Engineer to join their Inference Platform team in London. This role is pivotal in ensuring the reliability and scalability of the company's AI infrastructure, which is used to build foundation models for drug discovery. You will play a key part in hardening systems and ensuring the AI infrastructure is stable, reliable, and can handle increasing data volumes and model sizes as the company grows. This is an opportunity to contribute to groundbreaking innovation in applying AI to cure disease within an interdisciplinary team.

Salary not listed

We are seeking a highly technical and strategic Senior Developer Relations Manager to join our team, focusing on engaging developer ecosystems in emerging technology domains like Agentic AI, Generative AI, and Sovereign AI. You will work directly with software solution providers, developers, and industry professionals to champion the adoption of NVIDIA's advanced AI and computing platforms. The ideal candidate possesses deep technical expertise, a passion for developer advocacy, and the ability to communicate how NVIDIA technology solves complex, real-world challenges. This role involves accelerating critical workloads by demonstrating and integrating the NVIDIA software stack into partner products and guiding partners through onboarding and integration with technical resources.

Salary not listed

The opportunity involves designing and implementing end-to-end, client-specific AI architectures. This role focuses on integrating agents, models, enterprise data, applications, identity, and controls across both cloud and on-premises environments. You will translate business requirements into actionable architecture and implementation decisions, design various AI patterns including agentic workflows, RAG, and human-in-the-loop systems, and define hybrid deployment strategies considering constraints like residency, latency, security, performance, and cost. The role also includes evaluating technology choices, documenting architectural decisions and trade-offs, providing technical assurance during delivery, and collaborating with governance, Responsible AI, cyber, and privacy specialists.

Salary not listed

Salesforce is seeking a Field Service AI Technical Architect to join their "AI for Field Service" team. This role is crucial for both internal initiatives and global client-facing projects, focusing on leading customer discovery and implementing scalable AI solutions for complex field service scenarios. The architect will leverage technical expertise, AI, and automation strategies to drive innovation and continuous improvement in field service delivery, ultimately helping businesses achieve their goals through advanced technology.

Salary not listed

We are seeking an AI Platform Architect to design and evolve the reusable platform capabilities necessary for building, deploying, securing, observing, and scaling AI products across hybrid environments. This role involves defining reference platforms, environment topologies, network patterns, and access controls. You will design model access, compute, storage, vector services, orchestration, gateways, and shared platform services, supporting various deployment choices including cloud, sovereign, edge, and on-premises. A key aspect of this role is defining platform non-functional requirements for availability, performance, resilience, scalability, and cost, while creating reusable landing patterns and platform guardrails for delivery squads. You will also partner with MLOps Engineers on environment automation, observability, and release management.

Salary not listed

Inference has become a networking challenge, especially with disaggregated serving architectures where different stages of computation (prefill, decode, KV cache streaming) occur on separate GPU sets. Performance hinges on efficient tensor movement between GPUs, nodes, and storage. These elastic deployments require dynamic APIs for managing worker joins/leaves, connection management, and runtime rerouting without pipeline stalls. NIXL (NVIDIA's Inference Xfer Library) addresses these needs, underpinning NVIDIA Dynamo and various inference engines. This role involves working directly with platform teams building demanding inference deployments in China, identifying and resolving scaling issues, and contributing to upstream code and roadmaps. You will collaborate daily with core NIXL and Dynamo engineers across different regions.

Salary not listed

Together AI

The Infra Agent Systems team builds the software systems that power and automate Together AI's large GPU fleet. This role involves developing production AI agents that diagnose hardware failures, investigate incidents, correlate signals, and automate operational workflows. You will also build the platform these agents run on, including knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling. This is an opportunity to work at the intersection of AI agents, distributed systems, infrastructure, and automation, solving challenging engineering problems with real production impact. You will be responsible for delivering software and operating it in production.

Salary not listed

The NVIDIA PerfTech team is seeking a Senior C++ Software Engineer to develop the next generation of AI-powered developer tools. This role involves extending our developer-tools ecosystem into agentic software, focusing on building production-quality C++ components and integrations for NVIDIA's AI knowledge and developer-productivity service, Genie. You will contribute to agentic workflows and retrieval systems designed to help engineers find information, understand complex systems, and improve their productivity.

Salary not listed

We are seeking a Lead AI Engineer to provide hands-on engineering leadership for agentic AI products. You will define implementation patterns, ensure technical quality from prototype through production, and lead the technical design and implementation of agents, RAG services, tool integrations, and model orchestration. This role involves establishing coding, testing, evaluation, review, and documentation standards, decomposing architecture into engineering work, guiding estimation and sprint planning, coaching engineers, reviewing code, and resolving complex technical problems. You will also design evaluation suites for quality, safety, reliability, latency, and cost, and work with architects and MLOps to harden solutions for production.

Salary not listed

Together AI

Together AI is seeking an experienced AI Infra (Systems Engineers) Lead/Manager to join our team in Amsterdam. You will be responsible for keeping all user-facing services and production systems running smoothly, blending operational discipline with software engineering principles. This role involves applying sound engineering practices and automation to our operating environments and codebase, with a specialization in systems like operating systems, storage, and networking, while focusing on availability, reliability, and scalability.

Salary not listed

This role focuses on industrializing AI delivery by building automated deployment, evaluation, observability, and reliability engineering processes. You will be instrumental in creating robust CI/CD pipelines for AI services, prompts, agent configurations, and infrastructure. The position involves automating environment provisioning, testing, deployment, and rollback procedures, as well as implementing comprehensive monitoring, alerting, and operational dashboards for AI models and agents. A key aspect will be operationalizing evaluation thresholds, incident handling, and continuous improvement loops to ensure the reliability and efficiency of AI systems.

Salary not listed

Together AI

As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to strategic customers looking to leverage high-quality models and perform inference at scale. You will act as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment, partnering with Solutions Architects. FDEs add significant value by ensuring complex Proofs of Concept (POCs) are met, facilitating platform adoption, and guiding tailored optimization efforts, directly impacting customer success and platform hardening.

Salary not listed

Together AI

As a Customer Support Engineer at a pioneering AI company, you will be the first line of defense supporting customers building training, fine-tuning, and inference solutions. You will dive deep into complex technical challenges, providing swift and effective solutions while serving as a product expert. Collaborating closely with product and sales, you will drive continuous improvement of our offerings. This is an exciting opportunity for a deeply technical professional passionate about AI and customer success to make a significant impact in a fast-paced, innovative environment.

Salary not listed