Lead Data Engineer
First seen by Alion on Sep 15, 2026. Thinkwiseglobal scores B on the Alion truth index.
Job Title : Lead Data Engineer
Experience : 8 - 12 Years
Location : Hyderabad, Telangana, India
Industry : IT Services & Consulting
Role Overview :
We are hiring a Lead Data Engineer to design, develop, and optimize scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake. In this role, you will lead the architecture, construction, and maintenance of data lakehouse and data warehouse solutions, build high-performance data pipelines, enable business analytics, and establish data engineering best practices.
Key Responsibilities :
Architecture & Pipeline Design :
- Design, build, and optimize scalable batch and real-time ETL/ELT pipelines, data models, and lakehouse/data warehouse architectures using Microsoft Fabric, Databricks, or Snowflake.
High-Performance Data Processing :
- Develop robust data processing, cleansing, and transformation solutions using PySpark, Python, Scala, and SQL for large and complex datasets.
Analytics & Visualization Support :
- Support business intelligence and self-service analytics by enabling robust data models for Power BI and other visualization tools.
Technical Leadership & Governance :
- Establish coding standards, reusable frameworks, and data engineering best practices while conducting code reviews and driving CI/CD practices.
Quality & Reliability :
- Implement data quality, governance, security, access control, and monitoring while resolving complex production and performance bottlenecks.
Required Qualifications & Skills :
Education & Experience :
- Bachelor's/Master's degree in Computer Science, IT, Engineering, or a related field with 6 - 10 years of core data engineering experience.
Primary Platforms (at least one) :
- Microsoft Fabric : Data Factory, Lakehouse, Data Warehouse
- Databricks : Spark, Delta Lake, PySpark, MLflow
- Snowflake : Data Warehousing, Snowpipe, Performance Optimization
- Power BI : Data Modeling, DAX, Report Development
Core Technical Expertise :
- Exceptional skills in SQL, Python/Scala, PySpark/Apache Spark, and cloud data services (Azure, AWS, or GCP).
Engineering Standards :
- Deep expertise in data modeling, ETL/ELT concepts, CI/CD, Git, and DevOps workflows.
Skills
Data Engineering, ETL, Databricks, DataLake, Data Warehousing, Snowflake DB, SQL, Python, Scala, Data Modeling, Data Management