Prometheus Jobs

As a new grad Cloud Platform Engineer, you will write automation and infrastructure code to ensure the SambaNova inference service remains fast and available. This role involves building monitoring and dashboards, managing Kubernetes clusters and Terraform modules, and assisting with the setup of new regions. Upon ramp-up, you will join a shared on-call rotation to support production operations.

$131k - $197k

As a Principal Cloud Platform Engineer, you will specialize in our AI Inferencing Service, acting as the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational challenges. Your primary focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient resource utilization, directly impacting the experience of our customers and the success of our AI products. This role includes participating in a shared on-call rotation to maintain 24/7 service reliability.

$210k - $280k

CoreWeave is seeking a Senior Engineer to join its Benchmarking & Performance team. This role will focus on building performance insights and observability systems for AI infrastructure, covering everything from individual GPUs and interconnects to distributed training and inference workloads. You will be responsible for detecting, diagnosing, and surfacing performance signals across global data centers, transforming raw telemetry into actionable insights for engineers, product teams, and executives. This is a hands-on role focused on building observability tooling that provides near real-time answers about infrastructure performance, rather than a traditional data engineering or BI position.

$182k - $242k

CoreWeave is seeking a Junior Software Engineer to join their Inference team. In this role, you will be responsible for the end-to-end ownership of a production service, including feature development, maintenance of dashboards and alarms, and operational improvements. You will collaborate with cross-functional teams to enhance key service level indicators and contribute to the development of a cutting-edge inference platform that powers generative AI and real-time applications at scale.

$120k - $160k

CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team. This role will be instrumental in managing a planet-scale performance data warehouse, handling the ingestion, storage, transformation, and analysis of performance events across global data centers. The engineer will also contribute to industry-leading performance benchmarking publications like MLPerf. The position involves owning designs, elevating engineering standards, and driving measurable improvements in latency, throughput, and reliability across multiple services. Collaboration with product, orchestration, and hardware teams will be key to evolving the Kubernetes-native platform and meeting stringent P99 SLAs at scale.

$182k - $242k

CoreWeave is seeking a Senior Software Engineer focused on Inference to join their team. In this role, you will be an area owner, responsible for leading designs, elevating engineering standards, and delivering significant improvements in latency, throughput, and reliability across multiple services. You will collaborate with product, orchestration, and hardware teams to enhance our Kubernetes-native inference platform and meet stringent P99 SLAs at scale. This is an opportunity to work on a cutting-edge AI cloud platform during a period of hyper-growth, contributing to innovative solutions for complex problems.

$152k - $204k

CoreWeave is seeking a Senior Software Engineer I, Inference to join their AI Cloud team. This role involves owning specific areas of the inference platform, leading design efforts, and improving latency, throughput, and reliability. You will collaborate with product, orchestration, and hardware teams to enhance a Kubernetes-native inference platform and meet strict service level agreements at scale. The position requires a strong focus on engineering standards, incident management, and mentoring junior engineers.

$139k - $204k

Mercor is seeking an AI Infrastructure Engineer to build and manage the GPU and accelerator platform that powers our AI workloads. This role involves overseeing clusters, schedulers, training and inference serving, and the observability and cost data associated with fleet usage. You will write production code daily and own systems end-to-end, from design to on-call responsibilities. Mercor is a leading AI data company, building the layer between human expertise and frontier models, with a mission to organize human intelligence to power the AI economy. We are a profitable Series C company valued at $10 billion.

$200k - $400k

Figma is seeking an Engineering Manager for Observability to lead a team responsible for building and evolving systems that monitor the behavior of Figma's platform and its AI products in production. This role involves owning the core observability stack (metrics, logs, distributed tracing) and the emerging AI observability pipeline, which processes traces, conversations, and model outputs to classify and evaluate AI features. The manager will set strategy, improve instrumentation and data quality, and explore AI-driven approaches for anomaly detection and operational automation. This is a unique opportunity to shape a critical, early-stage platform that underpins all engineering teams at Figma.

$258k - $376k

NVIDIA is seeking a Senior Software Engineer to design and develop AIOps and Observability platforms. These platforms are crucial for monitoring, diagnosing, and optimizing millions of internal assets and services across various environments including cloud, on-premise, data centers, supply chain, and edge. You will collaborate with a team of engineers, product managers, and partners to shape the observability strategy, roadmap, and best practices for NVIDIA. Additionally, you will mentor other engineers in observability, machine learning, and related tools and techniques.

$200k - $322k

Enterprise AI is building the platform that enables reliable deployment of AI systems across enterprise environments. As a Platform Engineer, you will build and operate the core of Turing’s Enterprise AI platform, including platform services, the model gateway, multi-tenant infrastructure, CI/CD, infrastructure as code, and observability. The central challenge is creating repeatable deployments across environments Turing may not control, including client cloud accounts, dedicated instances, and sovereign installations. This role requires hands-on software engineering and operational ownership, with a focus on building production software and contributing deeply to platform services.

We help the world’s biggest brands move from brief to fully personalized campaigns — in days, not months. Founded by Abhay Parasnis and backed by Microsoft, GV, Salesforce, Lightspeed, Madrona and Menlo, we’re building category-defining technology at the intersection of creativity and AI with real impact. Join us to help shape the future of enterprise marketing. We're looking for a Staff Infrastructure Engineer to help lead core parts of our platform. You'll design, build, and scale the cloud infrastructure that powers our AI and GenAI workloads — ensuring reliability, security, and performance as we grow. This is your chance to shape the backbone of a platform trusted by Fortune 100 companies — building systems that are resilient, observable, and ready to scale with the next wave of AI.

$210k - $240k

Podium is seeking an SRE Manager to lead a team responsible for building and maintaining highly reliable infrastructure. This role involves a blend of technical leadership and people management, focusing on preventing incidents through automation, enhancing observability, and leveraging AI to optimize operations. The ideal candidate will be comfortable coaching engineers, managing projects, and driving incident resolution while fostering a culture of continuous improvement and blameless postmortems. This position offers the opportunity to significantly impact the reliability of Podium's AI-powered platform for local businesses.

Elastic is seeking a Senior Software Engineer to join the Elasticsearch - Storage Engine team. This globally distributed, fully remote team focuses on developing core storage and query technologies for observability workloads. The role involves designing, implementing, and optimizing Elasticsearch's core storage and query engine, with a focus on improving storage efficiency, advancing query processing and performance, and optimizing data layouts. The company emphasizes empowering individual engineers, code review, consensus-driven decisions, and incremental improvements in a collaborative, asynchronous environment.

$133k - $253k

d-Matrix is seeking a Sr Staff Site Reliability Engineer to join their AI Infrastructure team. This role is crucial for owning the infrastructure layer that powers all engineering teams and customers, encompassing colocation facilities, on-premises GPU clusters, cloud environments, and platform services. You will be responsible for reliability, automation, and observability across these diverse environments, managing systems end-to-end from provisioning to incident response. This is a hands-on position focused on building and operating real infrastructure, collaborating with hardware and software teams on CI/CD, QA, and HPC workloads, and supporting customer-facing deployments.

$175k - $265k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This is an architect-and-build role where you will set the architecture for automated bootstrapping of GPU data centers, high-performance virtualization, and fault-tolerant decentralized control planes, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer up to the global management plane that schedules capacity across all data centers. At this level, the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships.

$260k - $300k

Together AI

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining a fast LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Senior Software Engineer focusing on AI Compute, you will build and own major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware. This virtualized computing platform powers our own SaaS products and serves external cloud customers through self-serve offerings. The hard problems in rapidly scaling heterogeneous GPU fleets are software problems that we solve by building global and in-DC services, Kubernetes operators, and high-performance SDN libraries, forking hypervisors and Linux kernels, and building infra tailored to inference and fine-tuning. You'll own massive greenfield projects across their full lifecycle – scoping the problem, designing the system, and building it through to GA launch.

$220k - $270k

Together AI

As a Customer Success Engineer at Together AI, you will be the named technical owner for one of our most strategic customer relationships. You will serve as the primary technical point of contact across all infrastructure domains, including compute, networking, storage, and facilities, ensuring the flawless delivery and operational health of large-scale GPU deployments. This role is crucial for driving both customer success and company growth by combining deep infrastructure expertise with high-stakes customer partnerships.

$260k - $290k

Together AI

The Model Shaping team at Together AI focuses on products and research for tailoring open foundation models to downstream applications. We build services that enable machine learning developers to select optimal models for their tasks and enhance them with domain-specific data. Additionally, we develop novel methods for efficient model training and evaluation, drawing from diverse ideas in machine learning, natural language processing, and ML systems. As a Platform Engineer in this team, you will operate at the intersection of backend engineering and infrastructure, developing the core layers of Together’s platform for model customization and evaluation. Your role will involve designing, developing, and maintaining the backend services and underlying systems necessary for sustainably and reliably scaling production workflows for users and internal research experiments. You will collaborate cross-functionally with other engineers and researchers to enhance infrastructure based on project needs and integrate services with other engineering teams at Together.

$200k - $290k

Together AI

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle. The AI Infrastructure team is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues.

$200k - $280k