Senior AI Infrastructure Engineer Jobs

Supabase

Supabase is seeking a Software Engineer, AI Tooling Infrastructure to join their AI Tooling team. This role focuses on building and operating the backend services that power Supabase's AI products, such as the Supabase MCP server and services supporting agent skills and the dashboard assistant. The position involves ensuring these services are reliable, correctly authorized, and observable, handling the unique traffic patterns of AI clients and agents. It's a systems and infrastructure-focused role, requiring hands-on building and operation rather than just advisory. The ideal candidate thrives in fast-paced, asynchronous environments and is passionate about creating scalable developer tools.

Salary not listed

We are seeking an enthusiastic software engineer to join our AI networking acceleration team. You will work on a groundbreaking open-source library, utilizing hardware offloads, GPU Kernels, and RDMA network cards. Our product is a performance-oriented, low-level infrastructure designed to revolutionize inference. We foster a collaborative and innovative team environment, offering rewarding opportunities to work with industry leaders on transformative products.

$293k - $507k

Anduril Industries

Anduril's Continuous Integration platform is crucial for enabling all engineering teams to build, test, and deploy products globally. In this role, you will ensure this platform is reliable and fast, helping to build and deliver fully automated, faster, and more reliable CI pipelines. Your primary focus will be on functional and operational improvements that directly speed up the build, test, and deployment experience for critical business lines, with work that will compound across other products. You will deliver against a shared roadmap, own epics end-to-end, and instrument metrics to track improvements in the CI experience. This role involves working across a complex delivery ecosystem, multi-stage release pipelines, and Cloud and Robot environments where correctness has measurable consequences. If you enjoy building essential infrastructure for other engineers on systems that ship real defense technology, this is the role for you.

$191k - $254k

NVIDIA is seeking a Senior HPC Support Engineer specializing in Ethernet and AI Infrastructure to engage with prestigious customers. This role involves providing comprehensive solutions for sophisticated installations, maintenance, and operations of groundbreaking networking products within data center and networking technologies. As part of the NVEX Global Technical Support team, you will be a conscientious communicator focused on resolving issues and ensuring high customer satisfaction. A significant aspect of the role includes collaborating with Engineering, Marketing, and Support teams on technical matters.

$120k - $207k

Anduril Industries

Anduril Industries is seeking a Senior AI Infrastructure Engineer to lead the vision, execution, and long-term stability of how the company trains with GPUs at scale. This role involves taking ownership of cluster robustness, ensuring high-performance GPU systems are highly available, fault-tolerant, and resilient for ML platform and research teams. The primary focus is on logical stability and automated resilience, building self-healing mechanisms, tuning networking, and optimizing scheduling to ensure massive-scale training infrastructure runs seamlessly and scales efficiently.

$166k - $220k

Join NVIDIA’s Hyperscale Engineering team to develop networking solutions for large-scale AI infrastructure. You will work with customers and engineering teams to build, integrate, and improve software for BlueField and ConnectX platforms. Your work will span software development, system integration, troubleshooting, and performance analysis, helping customers move from initial testing to production deployment.

$184k - $357k

Anduril Industries

Anduril Industries is seeking a High Performance Computing (HPC) System Engineer to directly support sensitive programs by building and maintaining large-scale HPC infrastructure. This role offers the opportunity to work with leading engineers and cybersecurity professionals on cutting-edge systems deployed globally for national security missions. You will be instrumental in architecting, deploying, and managing advanced GPU infrastructure, ensuring the seamless operation of critical compute environments.

$147k - $196k

Netomi is seeking a hands-on DevOps Architect to design, build, and manage cloud infrastructure on AWS for their agentic AI platform. This role involves setting technical direction, writing infrastructure and automation code, and advising client stakeholders. The architect will also play a crucial part in leveraging AI tools to enhance development speed and quality while maintaining security standards. The company works with major global brands to enable AI-powered automation in customer experience.

Salary not listed

Vercel

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

$196k - $294k

CoreWeave

CoreWeave is seeking a Staff Software Engineer to join the Inference Platform Team. This team builds and operates CoreWeave’s Kubernetes-native inference platform, designed for low-latency, high-throughput AI workloads at massive scale. As a technical leader, you will drive architecture, performance, and reliability across multiple services and teams. Your responsibilities will include optimizing inference performance (latency, throughput, and GPU utilization), improving system reliability, and working deeply in distributed systems and Kubernetes-based infrastructure, focusing on areas like scheduling, batching, and memory optimization. This role requires hands-on technical leadership and the ability to influence engineering direction across the organization.

$188k - $275k

Fal

fal is building the generative media ecosystem for the next generation of AI products, providing the infrastructure, tools, and model access needed to move from idea to production at scale. We offer a unified platform for high-performance inference, orchestration, and observability, enabling new categories of AI-native products. As generative media reshapes industries, fal is becoming the foundation for ambitious teams. This role focuses on empowering fal's ML team by developing automation, infrastructure, and developer tooling to streamline the development, testing, and deployment of generative AI models. You will own and enhance CI/CD systems for a growing collection of ML models and inference pipelines, aiming to eliminate manual work, accelerate development cycles, and build reliable systems for confident model shipping and optimization.

$170k - $230k

Anduril Industries

Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. The Discovery team incubates and matures AI-native offerings across hardware, software, space, and cyber domains, architecting mission autonomy and mesh networking. As an Infrastructure Software Engineer on this team, you will build robust compute infrastructure for scalable machine learning operations, tackling challenges in networking, autonomy, and systems integration. Your work will ensure seamless integration of Anduril products, with opportunities to see your creations deployed in the field. You will embody a 'Whatever It Takes' mindset, making sound engineering decisions to deliver high-quality outcomes on time and working directly with customers on deployment.

$191k - $254k

CoreWeave

CoreWeave is seeking a Senior Engineer to join its Benchmarking & Performance team. This role will focus on building performance insights and observability systems for AI infrastructure, covering everything from individual GPUs and interconnects to distributed training and inference workloads. You will be responsible for detecting, diagnosing, and surfacing performance signals across global data centers, transforming raw telemetry into actionable insights for engineers, product teams, and executives. This is a hands-on role focused on building observability tooling that provides near real-time answers about infrastructure performance, rather than a traditional data engineering or BI position.

$182k - $242k

Join NVIDIA's ambitious team and be part of a legacy of innovation! We are seeking a Principal SW Architect, Networking to build the future of AI data-centers. This role is tailored for those passionate about collective communication, vertical co-development of AI networks, and large model training scalability. Your work will drive innovation and contribute to large-scale production, making a real impact on the world!

$272k - $431k

Anduril Industries

Anduril Industries is seeking a founding Staff AI Infrastructure Engineer to architect, build, and scale the end-to-end machine learning platform that powers the company's autonomous systems. This role will own the technical roadmap for the ML platform, building robust infrastructure, MLOps tooling, and systems architecture to train, evaluate, host, and serve complex AI models. The engineer will optimize experimentation velocity for AI Research Scientists, manage large datasets, and contribute to recruiting and mentoring the infrastructure engineering team.

$220k - $292k

NVIDIA is seeking a visionary Product Architect with strong expertise in systems architecture to join our AI Infrastructure and Agentic AI team. You will design and shape the architectures that connect the world's most powerful AI clusters, transforming ideas into well-defined, functional products by balancing technical feasibility with user needs and market demands. This role is at the nexus of designing and overseeing cutting-edge AI solutions from conception through their entire lifecycle, focusing on efficiency and multiplying efforts.

$184k - $357k

NVIDIA is seeking an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. This role focuses on building supercomputers and AI clusters using cutting-edge technologies. You will be instrumental in contributing to breakthroughs in artificial intelligence and GPU computing by providing insights on large-scale system design and tuning. You will collaborate with researchers, developers, and customers, working with the latest accelerated computing and deep learning platforms to craft improved workflows and develop innovative solutions. The position involves interacting with specialists in HPC, OS, GPU compute, and systems to architect, develop, and deploy large-scale performance platforms.

$176k - $334k

NVIDIA is seeking a senior or principal engineer to build cutting-edge infrastructure for large-scale foundation model training within the Generalist Embodied Agent Research (GEAR) group. This team is spearheading Project GR00T, an initiative focused on developing foundation models and full-stack technology for humanoid robots. You will collaborate with a research team known for influential work in multimodal foundation models, large-scale robot learning, embodied AI, and physics simulation, contributing to impactful research projects and product roadmaps.

$224k - $357k

Anduril Industries

Anduril Industries is a defense technology company focused on transforming military capabilities with advanced technology. We are seeking a Senior AI Infrastructure Engineer to build, scale, and optimize the end-to-end machine learning platform that powers our autonomous systems. In this role, you will own critical components of our ML platform and MLOps tooling, building and operating the infrastructure required to train, evaluate, host, and serve complex AI models across various environments. You will collaborate closely with AI Research Scientists and Platform Engineers to streamline model development, enhance hardware utilization, and ensure the reliable deployment of models into safety-critical operational settings.

$191k - $253k

We are seeking software engineers to work on next-generation graphics and computing products. Our charter is to develop the most demanding applications a GPU or high-performance computing server will encounter in its lifecycle, by collaborating closely with customers to support innovation in their factories and data centers. As a system software engineer, you will extensively use your knowledge of operating systems, algorithms, and computer architecture to provide robust and efficient solutions to validate and test next generation processors.

$184k - $357k

NVIDIA's GPU Architecture group is seeking world-class architects and software developers to lead architecture efforts. The role focuses on innovating in graphics and parallel computing to deliver the highest performance for deep learning and parallel processing algorithms. You will be responsible for developing and enhancing GPU architecture features, advancing parallel programming models, and designing new architectures to maintain leadership in AI computing. This involves interacting with other architects and researchers to build simulators, map deep learning workloads to hardware, and validate new architectural features.

$184k - $357k

NVIDIA Dynamo is a high-throughput, low-latency inference framework for serving generative AI and reasoning models across multi-node distributed environments. Built in Rust for performance and Python for extensibility, Dynamo orchestrates GPU shards, routes requests, and manages shared KV cache across heterogeneous clusters so that many accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the memory and compute budget of any single GPU, this platform enables efficient, resilient deployment of cutting-edge LLM workloads. We are seeking a Principal Systems Engineer to define the vision and roadmap for memory management of large-scale LLM and storage systems.

$272k - $431k

NVIDIA's Managed AI Research Superclusters (MARS) team is seeking a Senior GPU Supercomputer Scheduler Engineer to design and implement groundbreaking GPU compute clusters. This role involves developing solutions for demanding deep learning, high-performance computing, and computationally intensive workloads. You will contribute to the design and implementation of new scheduling features and services to optimize GPU compute clusters for fairness, occupancy, resilience, performance, and power usage. This is an excellent opportunity to deliver production-grade solutions, work with cutting-edge technology, and collaborate with technical leaders on significant challenges in machine learning, cloud computing, and system co-design.

$152k - $288k

NVIDIA is seeking an AI & Deep Learning Compiler Engineer to join its Deep Learning & AI Compiler (DLC) team. This role involves developing and optimizing the compiler that powers NVIDIA's inference engine across various platforms, from data centers to personal devices. The compiler is crucial for delivering leading inference performance, fast build times, reduced memory footprints, and ease of use for the global deep learning community. You will contribute to the next era of computing by enabling breakthroughs in areas like large language models and generative AI.

$152k - $242k