Kafka Jobs
40 open roles mentioning Kafka
Threat Intelligence Software Engineer, Cloudforce One
Cloudflare
Cloudforce One is Cloudflare’s threat operations and research team, focused on identifying and disrupting cyber threats, from criminal activity to nation-state sponsored APTs. The team collaborates with external organizations and internal Cloudflare teams to develop operational tradecraft and expand threat intelligence sources for expedited threat hunting and remediation. Leveraging data from one of the world’s largest global networks, team members analyze unique data points at scale to synthesize actionable threat intelligence and protect customers. As a Software Engineer on this team, you will manage the full software development lifecycle for systems supporting threat disruption and legal response. This involves translating complex legal and security requirements into robust, scalable, and high-performance applications that enhance internet safety and power.
Data Platform Engineer
Mercor
Mercor is a leading AI data company building the layer between human expertise and frontier models. We are seeking a foundational hire for our new Data Platform team to own the infrastructure that every data-driven team at Mercor runs on, including Snowflake, Fivetran, Airflow, and Hex. This role is crucial in setting the standards for data organization, access control, cost management, and operational reliability. You will work alongside researchers, operators, and AI companies at the forefront of shaping AI systems.
Senior Distributed Systems Engineer - Cache
Cloudflare
Cloudflare is seeking a Senior Distributed Systems Engineer to join the Cache team. This team builds and operates the high-performance reverse proxy and caching data plane at Cloudflare's edge, built on Pingora, Cloudflare's open-source Rust framework. The role involves working on backend routing, load balancing, cache storage, globally distributed purge, Tiered Cache routing, and production observability. You will design, implement, test, roll out, and operate these systems, ensuring performance, correctness, and resilience across Cloudflare's global network. This position is ideal for individuals who enjoy tackling complex problems related to latency, correctness, and reliability in large-scale distributed systems.
$194k - $266k
Software Engineer, Data Platform
xAI
The Data Platform team builds and operates the infrastructure responsible for all large-scale data transport and processing across the company. We own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability. As a software engineer on the Data Platform team, you will design, build, and operate the distributed systems powering SpaceXAI's data movement and compute. You will take ownership of infrastructure components that process trillions of events daily, driving the scalability, performance, and reliability of the systems that power product and ML workloads across the company.
$180k - $440k
Principal Software Engineer, Data
Cloudflare
Cloudflare is seeking an experienced, product-minded Principal Software Engineer to join the Town Lake team. This team is responsible for making vast amounts of data accessible and valuable across the company, building a modern, agentic-first data lakehouse platform. You will play a key role in taking this fast-growing internal platform to become the foundational data infrastructure for the entire company. This is a high-impact, high-visibility role where you will lead technical architecture and drive implementation for critical services, leveraging AI deeply to accelerate development and create innovative solutions. If you are a builder who thrives on solving complex problems and shaping the future of data platforms, this opportunity is for you.
Principal Engineer - Cloudforce One
Cloudflare
Cloudforce One is Cloudflare's threat operations and research team, focused on identifying and disrupting cyber threats from criminal activity to nation-state sponsored attacks. The team collaborates with external organizations and internal Cloudflare teams to develop operational tradecraft and expand threat intelligence for expedited threat hunting and remediation. Members leverage vast data from Cloudflare's global network to analyze unique data points at scale, synthesizing findings into actionable threat intelligence to protect customers. This role involves working across the full breadth of Cloudflare Products, tackling critical problems like redesigning detection pipelines, deploying edge capabilities, building agentic AI workflows, and architecting massive data systems. The ideal candidate is an architect, threat analyst, and disruptor who can rethink how threats are detected, analyzed, and neutralized across a global network.
Senior Backend Software Engineer - Core Backend, Cloud Customer Experience
crusoe
Crusoe is seeking a Senior Backend Software Engineer to join the Core Backend team within Cloud Customer Experience (CCX). This role is crucial for delivering a best-in-class user experience for Crusoe's AI-focused cloud platform. The Core Backend team is responsible for the foundational services that power every customer interaction, ensuring reliability and scalability. The work involves building and operating key systems like the API Gateway, Resource Management Layer, Quota Management, Notifications, and User Onboarding Flows, all while focusing on speed, reliability, and coherence as the platform grows.
$170k - $205k
Member of Technical Staff - Engineering Lead, Data Platform
Reflection ai
Reflection is building the trusted data backbone for the world's most capable open-weight AI systems. The Data Platform team builds and operates the core data systems and pipelines that power our research, training, and production environments, unifying ingestion, processing, and orchestration across the entire data lifecycle. We are seeking a front-line technical leader to build, mentor, and grow this team, guiding its technical direction while remaining hands-on. This role is for someone who has earned deep technical credibility as an engineer and now multiplies it through a team, working closely with our research team to understand the needs of high-velocity experimentation and translate them into reliable, reproducible, scalable data infrastructure.
Software Engineer, Marketplace
Mercor
As a Software Engineer on the Marketplace team, you will own the core systems that bring human intelligence to AI opportunities. You'll work on search, matching, allocation, and workflow infrastructure at the heart of the marketplace, where systems deliver the world's top experts to staff cutting-edge projects. The problems are technically demanding and tightly coupled to business outcomes: latency, reliability, throughput, and system quality all directly affect marketplace performance. This role sits on a core decision layer of the product, and your work will directly shape how the marketplace operates, including which opportunities get filled, how quickly hiring happens, and how reliably the system scales as volume and complexity increase.
Staff Software Engineer, Data Platform
Harvey
Harvey is seeking a Staff Software Engineer to join their central data platform team. This role is crucial for building the foundational systems that enable all teams at Harvey to work with data confidently and independently. You will be responsible for creating frameworks, tooling, and paved paths for product engineers, data engineers, and analysts, focusing on ingestion, warehousing, transformation, and real-time processing. A key aspect of this role involves ensuring data quality, lineage, governance, and handling sensitive data like PII and multi-region residency requirements, which are critical for serving security-conscious institutions.
$231k - $340k
Staff Software Engineer, Data Platform
Harvey
Harvey is seeking a Staff Software Engineer to join their central data platform team. This role is crucial for building the foundational systems that enable all teams at Harvey to work with data confidently and independently. You will be responsible for creating frameworks, tooling, and paved paths for product engineers, data engineers, and analysts, focusing on ingestion, warehousing, transformation, and real-time processing. A key aspect of this role involves ensuring data quality, lineage, governance, and handling sensitive data like PII and multi-region residency requirements, which are critical for serving security-conscious institutions.
$231k - $340k
Senior Software Engineer, Data Platform
Harvey
Harvey is seeking a Senior Software Engineer to join our central data platform team. This role is crucial for building the systems that empower all teams at Harvey to work with data confidently and independently. You will be responsible for creating frameworks, tooling, and paved paths for product engineers, data engineers, and analysts, focusing on their leverage and trust in our data systems. The initial focus will be on establishing a reliable foundation for ingestion and warehousing, including streaming and batch processing into Snowflake, CDC, orchestration, and schema evolution, while adhering to strict data sensitivity requirements. The role will expand to encompass transformation and compute frameworks, self-serve tooling, real-time stream processing, and robust quality, lineage, and governance layers, all while ensuring PII handling and multi-region data residency are satisfied by design.
$193k - $290k
Senior Software Engineer, Data Platform
Harvey
Harvey is seeking a Senior Software Engineer to join our central data platform team. This role is crucial for building the systems that empower all teams at Harvey to work with data confidently and independently. You will be responsible for creating frameworks, tooling, and paved paths for product engineers, data engineers, and analysts, focusing on their leverage and trust in our data systems. The initial focus will be on establishing a reliable foundation for ingestion and warehousing, including streaming and batch processing into Snowflake, CDC, orchestration, and schema evolution, while adhering to strict data sensitivity requirements. The role will expand to encompass transformation and compute frameworks, self-serve tooling, real-time stream processing, and robust quality, lineage, and governance layers, all while ensuring PII handling and multi-region data residency are satisfied by design.
$193k - $290k
Senior Software Engineer, Data Infrastructure
decagon
Decagon is seeking a Senior Data Infrastructure Engineer to design, build, and operate the data systems that power the company's AI products. This role involves owning critical data pipelines and storage layers end-to-end, enhancing reliability and performance, and establishing streamlined processes for engineers to confidently work with data at scale. The ideal candidate will contribute to building and maintaining the foundational infrastructure for a leading conversational AI platform.
$200k - $400k
Senior Data Engineer
Runpod
Runpod is seeking a Senior Data Engineer to join their remote-first team. This role is crucial for building and maintaining the AI Developer Cloud platform that serves over a million developers. You will be responsible for owning data pipelines end-to-end, from ingestion to data products, utilizing technologies like Snowflake, dbt, Dagster, Terraform, and AWS. The position also involves working in an AI-forward environment, delegating tasks to and extending the capabilities of autonomous AI agents, and critically reviewing their output. This is an opportunity to shape the future of AI infrastructure for the next generation of developers.
$175k - $220k
Senior Software Engineer - Defense Air
Applied Intuition
Applied Intuition is seeking a Senior Software Engineer to join their Air Combat Autonomy team. This role will focus on designing, developing, and enhancing simulation solutions for testing and training multi-agent autonomy software. You will be responsible for architecting LVC (Live, Virtual, Constructive) systems, creating simulation scenarios, writing interface code, conducting code reviews, and resolving integration issues. The position involves collaboration with cross-functional teams to translate requirements into technical solutions, mentoring junior engineers, and driving continuous innovation through testing, debugging, documentation, and CI/CD pipeline contributions.
$60k - $300k
Software Engineer, Trust & Safety
Gamma
Gamma is seeking a Trust & Safety Engineer to architect systems that protect its AI platform from phishing, abuse, fraud, and malicious content. This role is crucial for keeping millions of users safe while preserving the platform's creative freedom. You will join a small, high-impact team building the foundation for trust at scale, designing infrastructure that serves millions, shipping improvements daily, and building internal tools for support teams. Collaboration across engineering, product, and design will be key to defining Gamma's long-term safety approach.
$180k - $310k
Engineering Manager, Model Infrastructure
Harvey
Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise. This role offers a rare chance to help build a generational company at a true inflection point, with strong product-market fit and world-class investor support. The team moves fast, takes ownership, and is deeply committed to the mission, operating with intensity and pushing for excellence. As the Engineering Manager for Model Infrastructure, you will lead the team responsible for the platform powering every model request across Harvey, partnering closely with AI Research, Product Engineering, and Infrastructure to ensure reliability, scalability, and cost-efficiency. This is a strategic engineering organization, critical for every product capability, and will evolve to build the infrastructure for Harvey to train, evaluate, deploy, and operate its own frontier AI models.
$260k - $340k
Member of Technical Staff - Data Platform
Reflection ai
Reflection is a research lab dedicated to making intelligence open and accessible. We are building open models that empower individuals to control their intelligence and shape the future of AI. This role focuses on building and operating the company-wide foundations platform, providing reliable, scalable developer infrastructure, SRE capabilities, and high-throughput data ingestion tooling. The team designs and implements core data systems and pipelines that power research, training, and production environments, enabling high-velocity experimentation, reliable model development, and scalable production workflows by unifying ingestion, processing, and orchestration across the data lifecycle.
Software Engineer, Data Infrastructure
thinkingmachines
Thinking Machines Lab is seeking an engineer to join a high-impact team focused on data infrastructure. This role is crucial for architecting and scaling the core systems that power distributed training pipelines, multimodal data catalogs, and intelligent processing of petabytes of data. You will work directly with researchers to accelerate experiments, develop new datasets, enhance infrastructure efficiency, and derive key insights from our data assets. If you are passionate about distributed systems, large-scale data mining, and building foundational tools from the ground up, we encourage you to apply.
$350k - $475k