Remote AI Infrastructure Engineer Jobs

Supabase

Supabase is seeking a Software Engineer, AI Tooling Infrastructure to join their AI Tooling team. This role focuses on building and operating the backend services that power Supabase's AI products, such as the Supabase MCP server and services supporting agent skills and the dashboard assistant. The position involves ensuring these services are reliable, correctly authorized, and observable, handling the unique traffic patterns of AI clients and agents. It's a systems and infrastructure-focused role, requiring hands-on building and operation rather than just advisory. The ideal candidate thrives in fast-paced, asynchronous environments and is passionate about creating scalable developer tools.

Salary not listed

We are seeking an enthusiastic software engineer to join our AI networking acceleration team. You will work on a groundbreaking open-source library, utilizing hardware offloads, GPU Kernels, and RDMA network cards. Our product is a performance-oriented, low-level infrastructure designed to revolutionize inference. We foster a collaborative and innovative team environment, offering rewarding opportunities to work with industry leaders on transformative products.

$293k - $507k

Harvey is transforming legal and professional services by combining agentic AI, an enterprise-grade platform, and deep domain expertise. This is an opportunity to join a fast-scaling company at an inflection point, defining a new category in real-time. The team operates with intensity, ownership, and a commitment to excellence, driven by values of decisiveness, simplicity, and a "Job's Not Finished" mentality. As a Member of Technical Staff, Infrastructure in Harvey Research, you will build the systems that power the adaptation and improvement of leading open-weight models for legal work. You will own the infrastructure for scaling post-training efforts, including distributed training, RL rollout systems, agent environments, and internal tools for data management, evaluation, and job tracking. You will collaborate closely with researchers and contribute to decisions about system architecture and adoption.

$230k - $340k

Netomi is seeking a hands-on DevOps Architect to design, build, and manage cloud infrastructure on AWS for their agentic AI platform. This role involves setting technical direction, writing infrastructure and automation code, and advising client stakeholders. The architect will also play a crucial part in leveraging AI tools to enhance development speed and quality while maintaining security standards. The company works with major global brands to enable AI-powered automation in customer experience.

Salary not listed

Vercel

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

$196k - $294k

Fal

fal is building the generative media ecosystem for the next generation of AI products, providing the infrastructure, tools, and model access needed to move from idea to production at scale. We offer a unified platform for high-performance inference, orchestration, and observability, enabling new categories of AI-native products. As generative media reshapes industries, fal is becoming the foundation for ambitious teams. This role focuses on empowering fal's ML team by developing automation, infrastructure, and developer tooling to streamline the development, testing, and deployment of generative AI models. You will own and enhance CI/CD systems for a growing collection of ML models and inference pipelines, aiming to eliminate manual work, accelerate development cycles, and build reliable systems for confident model shipping and optimization.

$170k - $230k

NVIDIA is seeking an engineering lead to architect and scale the data acquisition infrastructure that powers our foundation models. This hands-on technical leadership role spans distributed systems, crawl infrastructure, and third-party data ingestion, focusing on building systems that discover valuable sources, crawl the open web at scale, and deliver reliable, high-quality data to training pipelines. You will own the architecture of a unified platform covering source discovery, URL indexing, crawl frontiers, predictive ranking, scheduling, distributed fetching, and ingestion, with the goal of bringing existing infrastructure to pretraining scale and extending it to additional model families, modalities, and acquisition workflows. You will also lead architecture reviews, critical implementation work, mentor engineers, and help build the team.

$272k - $431k

NVIDIA is seeking a Deep Learning Software Infrastructure Engineer to advance its Autonomous Vehicles project. In this role, you will be responsible for building and scaling the training libraries and infrastructure necessary for end-to-end autonomous driving models. By enabling training on thousands of GPUs and massive datasets, you will significantly accelerate iteration speed and enhance safety, working collaboratively with research and platform teams across NVIDIA.

$224k - $431k

AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical task. This role is ideal for engineers who thrive at the intersection of product, infrastructure, and software engineering and who want to build automated, intelligence-driven systems that protect NVIDIA’s most critical AI platforms.

$184k - $357k

Turing

Turing is seeking a Senior DevOps & Infrastructure Engineer to join their global Infrastructure Engineering team. This role focuses on building and maintaining the cloud infrastructure and developer platform that powers the company's operations. You will be responsible for making systems more reliable, secure, scalable, and efficient as the company grows. This is a hands-on position for an engineer who thrives on automating manual tasks, solving complex production issues, and elevating operational excellence. You will collaborate closely with application and security teams, working across cloud infrastructure, reliability, developer tooling, and security. The role offers meaningful ownership within a globally distributed team, requiring regular overlap with U.S. Pacific Time working hours and participation in a global on-call rotation.

Salary not listed

Vectara

Vectara is seeking a Senior/Staff Platform Software Engineer to build and scale the core infrastructure powering their AI agent platform. This role involves designing robust services and scalable systems with a focus on automation, observability, reliability, and performance. You will work on AI-assisted coding, lead code and system design reviews, and mentor team members. The position requires designing, implementing, and maintaining scalable and secure backend services, driving infrastructure automation, CI/CD, and monitoring pipelines, and collaborating with product and research teams to deploy and optimize ML/NLP workloads. You will also lead initiatives to improve system reliability and scalability, contribute to architecture decisions, and champion best practices in code quality and DevOps.

Salary not listed

Cohere

Cohere is seeking a Staff Forward Deployed Engineer to bridge the gap between frontier AI capabilities and complex customer realities. This role involves architecting high-performance, resilient machine learning systems within enterprise environments, acting as the primary technical liaison between Cohere's core engineering teams and strategic partners. You will own the architecture for customer-specific inference challenges, ensuring our large language models operate reliably, securely, and at peak performance within client infrastructure. The goal is to achieve exceptionally low latency, high throughput, and seamless resilience in production deployments.

$240k - $415k

Assort Health

Assort Health is building a continuous conversation for every patient, powered by an AI agent that remembers context and personal preferences. This AI-driven healthcare platform aims to revolutionize patient interactions, moving beyond the current system's forgetfulness. The company has experienced significant growth, with substantial funding and recognition, and is seeking individuals passionate about making healthcare more accessible.

$190k - $240k

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a highly skilled ML/AI Engineer to lead and support benchmarking of GPU platforms for machine learning and AI workloads. You will play a critical role in evaluating the performance of GPU-based hardware for various deep learning and AI frameworks, enabling data-driven decisions for platform optimisation and next-generation hardware development. This role involves working closely with hardware and development teams to profile and analyse GPU performance, evaluate and compare GPU performance across different platforms, and debug and optimise ML workloads to run efficiently on GPU hardware.

Salary not listed

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a GPU Cluster Architect to drive the design of our next-generation AI infrastructure. In this high-impact, hands-on role, you will make end-to-end architectural decisions across compute, networking, and storage, ensuring our platforms can meet the massive scale, performance, and reliability requirements of modern AI workloads. You will define how tens of thousands of GPUs are interconnected, cooled down, powered, and optimized across multiple data center sites.

$184k - $318k

Nebius is building a full-stack AI cloud platform for the global AI economy, supporting developers and enterprises from data and model training through to production deployment. Our Token Factory team is developing an inference platform for various foundation models, aiming to make them fast, reliable, and effortless to deploy at massive scale. We are seeking an engineer to ensure the flawless performance and graceful recovery of this platform under extreme load. This role involves owning the reliability, performance, and observability of the inference stack, from designing telemetry pipelines to tuning Kubernetes autoscalers and crafting resilient infrastructure. You will be instrumental in detecting, isolating, and remediating incidents quickly, and driving a post-mortem culture to prevent recurrence, all while meeting aggressive cost and reliability targets for scaling the platform.

Salary not listed

Nebius is building a full-stack AI cloud platform to support developers and enterprises from data and model training through to production deployment. We are seeking a Senior HPC Cluster Engineer to join our GPU & InfiniBand team. This role is crucial for enhancing and optimizing the core components of our Cloud platform, with a specific focus on GPU computing, InfiniBand networks, and the KVM/QEMU stack. You will work with hardware virtualization and device emulation technologies to ensure high performance and security in multi-GPU, HPC environments. The position involves analyzing, troubleshooting, and improving infrastructure to support new hardware, fine-tuning system performance, and automating fault detection and resolution in a complex system.

Salary not listed

Lightning AI is seeking an AI Platform Support Engineer for their APAC Customer Experience team. This role involves supporting Machine Learning (ML) engineers who manage large-scale training and inference workloads on cloud infrastructure, Kubernetes, and GPU platforms in production. You will act as a technical partner, diagnosing failures, enhancing reliability, and guiding customers through complex distributed systems challenges. The issues span Kubernetes scheduling, GPU orchestration, distributed PyTorch failures, inference latency, networking, storage performance, and platform reliability. This position offers exposure to diverse AI workloads and the opportunity to influence the infrastructure powering next-generation ML applications.

Salary not listed

Together AI

We are seeking a software engineer to develop a Kubernetes-native control plane for managing our GPU inference fleet. This role involves designing a manifest-driven API that allows the inference team to declare their needs for clusters, model deployments, or capacity changes. Our controllers will handle the underlying reconciliation, provider/runtime selection, and lifecycle management, abstracting away the complexities of the serving stack, scheduler, and hardware. You will also build systems to optimize fleet efficiency, including defragmentation, rebalancing logic for consolidating workloads, and scheduling/bin-packing improvements to maximize GPU utilization without impacting latency. The primary goal is to decouple users of the platform from operational complexities while maximizing hardware capacity. This includes building controllers, reconciliation loops, and self-service APIs/CLIs, along with event-driven systems for health, remediation, and utilization, all designed to operate without human intervention. A product mindset is crucial, focusing on the developer experience of internal platforms and APIs, with a 'build it, own it' philosophy that includes production operation and support.

Salary not listed

Vectara

Vectara is seeking a Platform Engineer to own the infrastructure that runs our deploy-anywhere platform. This role involves managing Kubernetes clusters for ML inference at scale, CI/CD pipelines, infrastructure as code, and the observability stack. You will be hands-on, writing Helm charts and Terraform, debugging issues, and shipping backend service features. The position requires deploying across AWS, GCP, and on-premises environments, including air-gapped setups, and participating in an on-call rotation to support enterprise customers.

Salary not listed

Zencoder.ai is building and orchestrating AI agents designed to handle real-world tasks like coding, research, and operations. What began as developer tooling has evolved into a collaborative platform for humans and AI agents working together on knowledge-based tasks. This role focuses on 'AI harness engineering,' ensuring the fundamental systems like CI/CD, testing, infrastructure as code, observability, and secure delivery are robust enough for AI agents to operate productively. The goal is to enhance developer experience and platform engineering, making workflows smoother for both humans and AI, and to integrate security seamlessly into the development process, addressing the evolving threat landscape posed by AI agents.

Salary not listed

Cresta

As a member of the infrastructure team, you will be responsible for designing, building, and advancing our core infrastructure. This role supports the engineering team in executing quickly, productively, and securely within a collaborative yet highly autonomous working environment. Each team member has a defined role with clear expectations and the freedom to pursue interesting projects.

$205k - $270k

As a Principal Software Engineer, you will set the technical direction for NVIDIA's global Developer Compute platform, which encompasses AI agent sandboxes and virtual desktop infrastructure. You will architect and build services to provision, stream, secure, and operate cloud-hosted compute environments at a global scale across AWS and Azure. These environments are designed to support both AI agents and the people who work with them. Your role involves partnering with engineering, IT, and security leaders across NVIDIA to transform AI and end-user workflows into reliable, high-performance platform capabilities, defining how agents and people access compute at the forefront of AI.

$248k - $391k

Egen

As a Senior AI Engineer, you will be at the forefront of our Generative AI initiatives, treating AI as a software engineering discipline. You will be responsible for the full lifecycle of our AI features, taking them from initial prototype to robust, scalable production services, while solving for real-world constraints like latency, error handling, and cost optimization. You’ll collaborate with a diverse range of clients to translate business needs into high-performance AI architectures. This role requires a blend of deep technical expertise in LLMs and a disciplined Software Engineering approach to ensure our solutions are robust, ethical, and scalable.

$159k - $219k