Senior Data Engineer
In-Office
Posted 1d ago
Job Location
In-Office
Tech Stack
Remote Work Policy
On-site
Categories
Machine Learning Engineer
About the job
We are seeking an experienced Data Engineer to join our Austin team and contribute to the development of our internal data products. In this role, you will build data-driven applications that empower various teams across the company, including go-to-market, engineering, and product. You will be involved in the entire product lifecycle, from defining requirements and designing features to implementation and ongoing ownership. You will focus on creating scalable and reliable systems to address critical business challenges, collaborating with full-stack engineers on new features and managing the data pipelines and services that support our applications. Our technology stack is diverse, encompassing languages like Go and Scala, and technologies such as ClickHouse, with continuous evolution. Many of our products also integrate significant AI components, offering opportunities to develop advanced, AI-ready data layers and work with modern AI infrastructure and tools like vector databases, MCP-based services, and Workers AI.
Responsibilities
- Design and implement scalable, performant, and maintainable data pipelines and services using Go and Scala.
- Collaborate with engineers, analysts, and product stakeholders to design solutions for strategic initiatives, business-critical data products, and agentic AI architectures.
- Enhance the data platform architecture for improved scalability, reliability, observability, and data correctness.
- Build and manage high-quality, well-modeled datasets for internal products, predictive analytics, and LLM-enabled features.
- Develop a comprehensive understanding of the company's data ecosystem and collaborate with data and system engineers to improve data ingestion, quality, and governance.
- Lead by example through design reviews, knowledge sharing, and mentorship to elevate technical standards and data engineering practices.
Requirements
- Experience in designing and implementing scalable, performant, and maintainable data pipelines and services.
- Proficiency in Go and Scala.
- Experience with data platform architecture, scalability, reliability, and observability.
- Experience building and managing datasets for internal products, predictive analytics, and LLM-enabled features.
- Understanding of data ingestion, quality, and governance principles.
- Experience with vector databases, MCP-based services, and Workers AI is a plus.
- Experience with ClickHouse is a plus.