Model Serving Jobs

Luma is seeking a Research Scientist/Engineer to build the systems that enable reinforcement learning (RL) at a frontier scale. This role involves coupling policy optimization with large fleets of inference workers, agentic environments, and reward/verification systems to translate model behavior into learning signals. RL is crucial for Luma's models to evolve from capable to useful. This is a full-loop systems problem encompassing training, rollout generation, environment execution, and reward computation across thousands of GPUs, requiring speed, stability, and correctness. The ideal candidate has experience with post-training LLMs using RL, building environments and verifiers, and debugging large-scale asynchronous rollout pipelines.

Luma is seeking a Software Engineer to own the serving of their AI models. This role involves integrating new model architectures into the inference engine, scaling deployments across thousands of machines, and optimizing the utilization of expensive GPU fleets while meeting internal service level objectives (SLOs). The work focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and ensuring reliability across diverse clusters and hardware providers. This position is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale, rather than those seeking pure modeling work.

Luma is seeking a Software Engineer to own the serving of their AI models. This role involves integrating new model architectures into the inference engine, scaling deployments across thousands of machines, and optimizing the utilization of expensive GPU fleets while meeting internal service level objectives (SLOs). The work focuses on large-scale inference systems, including scheduling, fleet management, deployment pipelines, and ensuring reliability across diverse clusters and hardware providers. This position is ideal for a strong systems engineer comfortable with model serving and Kubernetes at scale, rather than those seeking pure modeling work.

$195k - $345k

NVIDIA is seeking a Senior Applied AI Engineer to develop intelligent software systems aimed at enhancing engineering productivity and software quality at scale. This role involves creating AI-powered workflows and services to analyze complex code, extract meaningful insights from large engineering datasets, and accelerate debugging and decision-making processes. You will operate at the intersection of software engineering, machine learning, and developer productivity, transforming advanced AI capabilities into practical, reliable tools for real-world engineering environments.

$152k - $242k

We are seeking a Senior Developer Relations Manager to build the developer ecosystem around NVIDIA Dynamo, an open-source framework for distributed AI inference. In this senior individual contributor role, you will help developers deploy and operate inference systems, build practical technical resources, and represent developer needs both in the community and inside NVIDIA. You will build the ecosystem with various inference projects through joint demos, integration guides, upstream contributions, and community programs. You will also develop runnable demos, sample code, technical documentation, and videos to explain Dynamo’s modular ecosystem and demonstrate its data center performance value. Additionally, you will represent the developer community inside NVIDIA by translating feedback into engineering and product requirements, influencing priorities, and communicating progress back to developers. You will advocate externally through technical talks, live demos, workshops, and office hours, helping developers troubleshoot real deployments and contribute to projects.

$184k - $357k

CHAOS Industries is seeking a highly motivated, mission-oriented Applied AI Engineer to help develop, integrate, and deploy AI/ML-powered capabilities across its product lines. This role involves working closely with data scientists, software engineers, product teams, and mission stakeholders to conduct advanced AI research and translate it into reliable, real-world software, with a particular focus on defense applications requiring extreme accuracy under constrained, adversarial, and complex operational conditions. The ideal candidate possesses strong data science and software engineering fundamentals, a track record of technical excellence, and demonstrated experience applying AI/ML techniques to real products, with a strong plus for experience in aerospace, defense, critical infrastructure, robotics, RF systems, or other highly regulated or mission-driven environments. Comfort with operating independently, quickly learning new technical domains, collaborating across teams, and moving prototypes toward production with limited oversight is essential.

$140k - $193k

Metriport is revolutionizing US healthcare by solving the critical problem of medical data exchange. We transform unusable raw data from legacy systems into a clean, unified format that care teams and their agents can use to improve patient outcomes. Our technology enables rapid data retrieval, providing clinicians with complete patient histories instantly, which can lead to earlier diagnosis and treatment. We are a technology company building every layer of our platform, from data connection and transformation to generating insights, aiming to become the essential infrastructure for US healthcare. Having secured significant funding and achieved product-market fit with millions in ARR and over 100 customers, we are poised for substantial growth.

$200k - $260k

Knowtex is seeking an ML Engineer / Researcher focused on Large Language Models to contribute to the next generation of their AI stack. This role involves developing and optimizing models for clinical documentation and structured clinical reasoning, aiming to enhance quality, cost, latency, and control. The position is research-heavy with a direct path to production, requiring the design of experiments, building datasets and evaluation systems, and fine-tuning and post-training models. The successful candidate will collaborate closely with engineering and clinical teams to deploy solutions at scale and will play a key role in shaping Knowtex's long-term LLM strategy.

Reducto is seeking a Software Engineer for its Platform team to own the infrastructure behind the company's core API. This role involves ensuring document understanding systems are fast, reliable, and cost-efficient at scale. You will work across Python services, queues, model-serving, Kubernetes, observability, and developer tooling to enhance the platform's robustness. This is a high-leverage infrastructure position for someone who has built and operated production systems, prioritizes latency, reliability, and cost, and is adept at using modern LLM coding tools.

$200k - $325k

Databricks

At Databricks, we are passionate about enabling data and AI teams to solve the world's toughest problems by building and running the world's best data and AI infrastructure platform. As part of the AI Platform team, you will build the substrate that powers everything from data apps, AI agents, model training, model serving, and vector search. You will be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses helping thousands of our customers democratize AI within their organizations, and we are building the infrastructure that powers the next generation of AI.

$166k - $225k

Databricks

We are seeking a Partner Engineer to manage the technical relationships with Databricks' strategic AI partners, including Anthropic, OpenAI, and Google Gemini. In this high-impact role, you will be responsible for co-owning the joint roadmap with partner product teams, driving the development of integrations that enhance both platforms, and actively engaging with new product features and tooling. You will collaborate with partners to create Proofs of Concept (POCs), demonstrations, and hands-on labs that will ultimately form the architectures our customers deploy. This position offers direct visibility to our founders and executives and sits within the Partner Engineering team, working closely with Product, Engineering, Strategic Partnerships, and Global Go-to-Market teams.

$150k - $206k

Sierra is a leading platform for customer-facing AI agents, partnering with major brands to transform customer service and business growth. The Applied Research team focuses on enhancing the quality, speed, and cost-efficiency of AI agents. This involves advancing post-training techniques for open-weight models, pioneering new approaches in voice AI, and translating research breakthroughs into robust production systems. The role involves tackling complex AI and ML challenges, building agents capable of reasoning and executing intricate tasks, and determining the optimal balance between custom models and external intelligence to maximize customer value.

Sierra is seeking a Software Engineer for its Inference team to build the systems that power their AI agents. This role focuses on making foundation models fast, reliable, and efficient at scale. You will define the inference architecture, working on systems for serving, routing, capacity management, and optimization for latency, reliability, and cost. This is a systems-first role at the intersection of distributed infrastructure and AI, requiring strong distributed systems fundamentals and experience with complex systems problems.

$230k - $390k

Baseten powers mission-critical inference for leading AI companies, enabling them to bring cutting-edge models into production. We are seeking distributed systems engineers and product-minded generalists to build the distributed runtime that powers large-scale LLM inference on Baseten. Our inference platform ensures customers can deploy and operate advanced models with industry-leading performance, scalability, and reliability. You will work across the entire stack, from the developer experience for model deployment to the systems orchestrating Kubernetes and routing traffic efficiently, ensuring every model on our platform is fast, reliable, and cost-efficient.

$180k - $360k

At Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML pipeline spans 10,000+ miles of labeled survey data, image segmentation networks, and 3D prediction models serving real-time inference to surveyors and engineers in the field. This role is ideal for mid-career ML infrastructure engineers with experience building for both training and inference. You'll build training pipelines that handle deep transformer models on hundreds of terabytes of 3D point cloud and image data. You'll also architect our inference infrastructure, delivering both heavy offline detection algorithms and real-time responsive inference that integrates directly with our CAD software.

$160k - $250k

Anthropic

Reinforcement learning (RL) is crucial for Claude's ability to reason, write code, and act autonomously over long horizons. This role is part of the team responsible for building and maintaining the RL training system, which is used to train production models and for researchers across Anthropic to run their experiments. The team collaborates closely with research teams company-wide on the science and engineering required to scale RL effectively. As a Research Engineer, you will be at the heart of RL at Anthropic, with a direct view of RL training at the frontier, as the system you own supports both production and research runs. You will work with collaborators across research teams to understand system performance, identify areas of fragility, and drive future improvements.

$500k - $850k

SambaNova is seeking a Senior Developer Advocate, AI Content & Community to enhance the visibility and utility of its AI infrastructure technology. This role involves hands-on development of compelling demos and applications using SambaCloud, alongside building relationships within the developer ecosystem to amplify SambaNova's offerings. The ideal candidate will be adept at prototyping, clearly explaining complex technology, and effectively communicating through various media, including live presentations and digital content.

$196k - $240k

Harvey is transforming legal and professional services by integrating advanced agentic AI with an enterprise-grade platform. This role is a founding position on the Security Engineering team, focused on building the foundational security for AI agents. You will lead the development of a platform that enables agents to perform security work, including vulnerability discovery and validation through authorized penetration testing, while ensuring data and system protection. The work involves shaping how agents are sandboxed across product and internal platforms, building execution environments, orchestration, and controls, and enabling the secure internal use of open-source models.

$231k - $346k

OpenAI

We are seeking a software engineer to build and evolve our classification and evaluation platform. You will develop services, online and offline pipelines, and tools that help researchers and data scientists turn an idea into a working measurement and iterate on it quickly. This role combines software and data engineering with hands-on production ownership. You will shape the architecture, deliver new capabilities, improve inference efficiency, and keep the system dependable as workloads and requirements evolve. Strong candidates will bring deep software engineering expertise and an interest in building a technical product in close partnership with its users.

$347k - $445k

Anthropic

Anthropic's production models undergo sophisticated post-training processes to enhance their capabilities, alignment, and safety. Decisions in production training depend on knowing how the model is really behaving. This role's mission is to have the best observability into production post-training runs at Anthropic, providing the clearest, most trusted view of model quality during training. You will shape what gets measured, keep the signal trustworthy and timely, and investigate surprising results to inform post-training and release decisions.

$500k - $850k