Lead Data Engineer
Salary not listed • Hybrid in Bangalore, India • Full-time
Posted 4mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
About the job
HackerRank is seeking a Lead Data Engineer to join their data organization. This role is a senior individual contributor position focused on evolving the company's data platform, which has recently undergone a significant modernization. The primary goal is to build an AI-native data layer that will power new revenue-generating features, including natural language querying for customers. This is a greenfield opportunity to shape the future of data at HackerRank, collaborating with AI, product, and go-to-market teams to deliver data-driven features.
Responsibilities
- Own and evolve the data platform (StarRocks, Apache Hudi, Trino, Spark, Apache Ranger), ensuring performance, reliability, and security.
- Build the next-generation AI-optimized data layer for natural language querying and AI add-on features.
- Own in-product data features such as exports, insights dashboards, and custom reports.
- Enable self-service data pipelines for internal teams to reduce ad-hoc requests and scale data access.
- Enforce robust data security, including access controls and policies.
- Lead technical design reviews and define engineering standards for the data team.
- Partner with PMs and business stakeholders to identify and scope AI-enabled data use cases.
Requirements
- 6+ years of data engineering experience, with at least 2 years in a senior or lead capacity.
- Deep hands-on expertise with OLAP databases (e.g., StarRocks, ClickHouse, Druid).
- Strong experience with data lake technologies (e.g., Apache Hudi, Iceberg, Delta Lake).
- Proficiency with distributed query engines (Trino/Presto) and batch/streaming compute with Apache Spark.
- Solid understanding of data security, RBAC, and access control tools (e.g., Apache Ranger).
- Comfortable working in a hybrid AWS + open-source self-managed environment.
- Strong communication skills to translate technical decisions for non-technical stakeholders.
- Ability to drive cross-functional projects independently.