NATS Jobs
3 open roles mentioning NATS
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
Together AI
We are seeking a software engineer to develop a Kubernetes-native control plane for provisioning and managing our GPU inference fleet. This role involves designing a manifest-driven API that allows the inference team to declare their needs, such as clusters, model deployments, or capacity adjustments. Our controllers will handle the underlying reconciliation, provider/runtime selection, and lifecycle management, abstracting away the complexities of the serving stack, scheduler, or hardware pool. You will also build systems to ensure fleet efficiency, including defragmentation, rebalancing logic for consolidating workloads, and scheduling/bin-packing improvements to maximize GPU utilization without compromising latency. The core objective is to decouple platform users from operational complexities while optimizing hardware capacity. This includes developing controllers, reconciliation loops, and self-service interfaces (API/CLI) for seamless operation, alongside event-driven systems for health monitoring, remediation, and utilization management, all designed to operate without human intervention. A product-oriented mindset is crucial, with a focus on building internal platforms and APIs that enhance the developer experience for consuming engineering teams. This role operates under a "you build it, you own it" philosophy, encompassing both software delivery and production support.
$160k - $280k
Senior Software Engineer
Parloa
Parloa is at the forefront of a new era in customer experience, powered by agentic AI. We aim to make every customer conversation effortless, transforming support into meaningful exchanges. Our platform has already powered over a billion interactions for global enterprise brands. As a Senior Software Engineer, you will work on a marketplace of tools and integrations that enhance Parloa's AI agents, ensuring secure and scalable access to business systems. While experience with our specific stack is not required, a willingness to learn and code in Typescript is essential.
AI Infrastructure Engineer
Spellbrush
Spellbrush, a leading generative AI studio, is seeking an AI Infrastructure Engineer to build and manage end-to-end ML infrastructure for running their state-of-the-art models across all platforms. This role involves designing and implementing next-generation inference architectures to support mobile and web applications, serving millions of users. The ideal candidate will work within a fast-paced, nimble team alongside top AI researchers, contributing to cutting-edge image generation models.