Sr. Data Engineer
Salary not listed • Hyderabad, Telangana, India • Full-time
Posted 4mo ago
This job has been open for more than 60 days. It may no longer be actively hiring, so check with the company before putting a lot into an application.
About the job
We are seeking a Sr. Data Engineer to help drive the technical vision of our Data Engineering team as we scale our infrastructure, services, and architecture. This role is ideal for someone who blends deep technical expertise with strategic thinking and cross-functional influence. As a Sr. Data Engineer, you will partner closely with other data and analytics engineers, architects, product leaders, and business stakeholders to evolve our data infrastructure in support of high-trust, scalable, and business-aligned outcomes. You’ll also serve as a force multiplier across teams, raising the bar for data engineering excellence and accelerating the maturity of our data platform capabilities.
Responsibilities
- Develop and maintain robust ETL/ELT pipelines for data ingestion, transformation, and loading from multiple sources.
- Ensure data pipelines are scalable, fault-tolerant, and optimized for batch and near real-time processing.
- Develop interactive dashboards, scorecards, and KPI reporting solutions using BI tools, aligned with business goals.
- Automate repetitive manual reporting processes using scripting and workflow orchestration tools.
- Collaborate with stakeholders to understand data integration and reporting needs, define KPIs, and translate requirements into technical solutions.
- Implement data validation, reconciliation controls, lineage documentation, and metadata standards for data governance.
- Provide technical guidance, code reviews, and best practices to junior team members.
- Investigate and resolve production incidents related to pipelines, reports, and data mismatches, performing root cause analysis.
- Continuously improve platform reliability, performance, scalability, observability, security, and cost efficiency.
- Assist in the implementation and maintenance of information security activities.
- Ensure team competence related to information security.
- Implement security policies and procedures.
Requirements
- 5+ years of experience in Data Engineering, including designing scalable data platforms, building ETL/ELT pipelines, optimizing data workflows, and implementing cloud solutions.
- 5+ years of experience developing automated data ingestion pipelines from multiple streams into enterprise platforms.
- Strong proficiency in writing and tuning advanced SQL queries, views, and data models.
- 5+ years of proven expertise in cloud-based, distributed environments (e.g., AWS, EMR, Glue, Iceberg, dbt, Lambda, Athena).
- Demonstrated experience designing and managing secure client data integrations (file exchanges, SFTP, API-based ingestion).
- Fluency with modern data architecture patterns (medallion/lakehouse models, schema evolution, streaming ingestion, batch orchestration).
- Familiarity with reporting and dashboarding tools (e.g., AWS QuickSight, Tableau).
- Experience designing and maintaining low-latency, high-availability data pipelines for near real-time processing.
- Experience monitoring production pipelines and triaging data incidents, performing root cause analysis.
- Experience implementing data governance, observability, and quality controls (schema validation, lineage tracking, alerting, reconciliation).
- Knowledge of CI/CD pipelines, version control, and DevOps practices (e.g., GitHub, AWS CodePipeline).
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline.