Azure Data Engineer
First seen by Alion on Sep 3, 2026.
About the Role :
Key Responsibilities :
- Design, develop, and optimize ETL/ELT pipelines using Azure Data Lake, Azure Databricks, and PySpark.
- Implement Medallion Architecture (Bronze/Silver/Gold) to support data quality and governance.
- Build and maintain data models using Star and Snowflake schemas for reporting and analytics.
- Collaborate with data scientists and business stakeholders to translate requirements into technical solutions.
- Manage CI/CD workflows with GitHub or Azure DevOps, ensuring automated testing and deployment.
- Monitor pipeline performance, troubleshoot issues, and implement improvements.
- Enforce data quality and governance standards across all data assets.
Required Skills :
- 5 - 8 years of experience in Azure Data Engineering
- Strong expertise in Azure Databricks, PySpark, SQL, dbt, and Airflow
- Experience building scalable ETL/ELT pipelines on Azure Data Lake
- Hands-on experience with Medallion Architecture (Bronze/Silver/Gold)
- Strong data modelling skills (Star/Snowflake schemas)
- Knowledge of CI/CD, GitHub/Azure DevOps, and data quality/governance practices
- Good understanding of analytics, reporting, and AI/ML data platforms
- Databricks certification is required
- DBT Experience required
Skills
Azure, Data Engineering, Azure Databricks, PySpark, SQL, Data Build Tool, Apache Airflow, ETL, Medallion Architecture, Data Modeling