Senior Data Engineer
In-Office
Posted 10d ago
Remote Work Policy
On-site
Categories
Applied AI Engineer
About the job
The Data Intelligence & Analytics organization builds core data platforms and internal products that drive company-wide decision-making. We design and operate large-scale data systems, manage the company's data lake and ingestion infrastructure, and develop end-to-end applications transforming complex datasets into reliable business-critical products. This role sits at the intersection of data platforms, distributed systems, and product development, offering opportunities to own problems across the stack, build specialized data solutions for predictive modeling and machine learning, and construct systems that run the business. We are seeking an experienced Data Engineer to join our Bengaluru team to scale the development of internal data products. You will build data-driven applications empowering go-to-market, engineering, and product teams, with end-to-end involvement from requirements shaping to long-term ownership. You will work on scalable, reliable systems solving critical business problems, partnering with full-stack engineers to develop new features and operate data pipelines and services. Our stack includes Go, Scala, and ClickHouse, and we are incorporating AI components, vector databases, MCP-based services, and Workers AI.
Responsibilities
- Design and implement scalable, performant, and maintainable core components of data pipelines and services using Go and Scala.
- Collaborate with engineers, analysts, and product stakeholders to design solutions for strategic initiatives, business-critical data products, and agentic AI architectures.
- Contribute to the evolution of the data platform architecture, enhancing scalability, reliability, observability, and data correctness.
- Build and curate high-quality, well-modeled, and contextual datasets for internal products, predictive analytics, and LLM-enabled features.
- Develop a deep understanding of the company's data ecosystem and collaborate with global data engineering teams to improve data ingestion, quality, and governance.
- Develop and maintain robust data pipelines and services that support internal data products and AI initiatives.
- Optimize data processing and storage for performance and cost-efficiency.
- Ensure data quality and integrity throughout the data lifecycle.
- Participate in on-call rotations to support production data systems.
- Mentor junior engineers and contribute to a culture of technical excellence.
Requirements
- Experience in designing and implementing large-scale data pipelines and services.
- Proficiency in programming languages such as Go and Scala.
- Experience with distributed systems and data processing frameworks.
- Familiarity with data warehousing solutions like ClickHouse.
- Experience with cloud platforms and services.
- Strong understanding of data modeling and database design.
- Experience with AI infrastructure and tools, including vector databases, is a plus.
- Excellent problem-solving and analytical skills.
- Ability to work effectively in a collaborative team environment.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.