Senior Data Engineer
First seen by Alion on Aug 27, 2026.
Role: Senior Data Engineer
Location: Hyderabad
What we're looking for:
- 57 years of data engineering experience delivering production data products at enterprise scale.
- Hands-on experience with modern Lakehouse platforms (Delta Lake, Unity Catalog, PySpark, SQL); strong performance tuning and tiered data product design.
- Hands-on experience with cloud data warehousing (SQL, secure views, role-based access, warehouse optimization).
- Strong SQL fundamentals: query optimization, set-based transformations, reconciliation patterns, SCD Type 1 and Type 2.
Key Responsibilities :
- Design and implement end-to-end data ingestion and transformation pipelines using Azure Data Factory to ensure seamless data flow across the enterprise.
- Develop high-performance data processing solutions using PySpark and Databricks to handle large-scale datasets and complex analytical workloads.
- Collaborate with stakeholders to translate business requirements into technical data models that drive strategic growth and operational efficiency.
- Optimize existing data architectures for cost, performance, and scalability to support the evolving needs of our global client base.
- Mentor junior engineers through code reviews and technical guidance to foster a culture of engineering excellence and continuous improvement.
- Automate data quality checks and monitoring processes to maintain high standards of data integrity and reliability across all production environments.
Tech Stack :
- Azure Data Factory, Azure Databricks, Microsoft Fabric, Delta Lake, SQL, PySpark, Python, DBT (Data Build Tools), Medallion Architecture, Real time Streaming Pipelines, Snowflake, Data Modelling, ETL/ELT Pipelines, Control-M, CI/CD, GITLAB
Skills
Data Engineering, PySpark, Azure Databricks, Data Warehousing, SQL, Azure Data Factory, Python, Snowflake DB