Senior Azure Data Engineer - Python/PySpark

Job Description :

Responsibilities :

- Engage with business and technical stakeholders to understand data requirements and translate them into robust technical designs and architecture.

- Own solution planning, task breakdown, and end-to-end delivery execution.

- Design and develop optimized ETL/ELT pipelines, ensuring high data quality, reliability, and performance.

- Collaborate effectively with cross-functional and internal teams to deliver technical solutions.

- Troubleshoot data and system issues, optimize performance, and ensure timely delivery.

- Mentor and guide junior developers, ensuring adherence to best practices and engineering standards.

- Resolve complex technical challenges and provide support throughout the development lifecycle.

- Maintain BI platforms, optimize performance, and ensure accuracy and consistency of reporting.

Experience & Skills :

- 10 - 13 years of experience in Data & Analytics, with 5+ years of hands-on experience in Azure data engineering technologies.

- Strong hands-on expertise in Python, SQL, and PySpark.

- Strong experience with Databricks Unity Catalog for data governance and security.

- Strong sense of ownership, accountability, and execution discipline across multiple initiatives.

- Excellent communication skills, with the ability to effectively engage and manage business stakeholders.

Skills

Azure, Data Engineering, ETL, SQL, Python, PySpark, Data Governance, Azure Databricks, Data Quality