Data Engineer (Azure)

We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate should possess strong expertise in Azure Data Engineering, Python, PySpark, SQL, and Databricks, with hands-on experience in building modern data pipelines and data lake architectures.

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure services.
• Build and optimize data processing solutions using PySpark and Azure Databricks.
• Develop robust data ingestion frameworks from multiple structured and unstructured data sources.
• Create and maintain data models, data warehouses, and data lakes to support business analytics.
• Write complex SQL queries, stored procedures, and performance optimization scripts.
• Collaborate with business stakeholders, data analysts, and application teams to understand data requirements.
• Implement data quality, governance, security, and monitoring processes.
• Troubleshoot and resolve data-related issues, ensuring high availability and reliability.
• Participate in code reviews, design discussions, and best practice implementation.
• Support cloud migration and modernization initiatives involving Azure data platforms.

Requirements:

• Strong experience in Azure Data Engineering.
• Proficiency in Python and PySpark.
• Hands-on experience with Azure Databricks.
• Advanced knowledge of SQL and database concepts.
• Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
• Understanding of data warehousing and big data technologies.
• Experience in performance tuning and optimization of data pipelines.
• Knowledge of CI/CD practices and version control tools such as Git.
• Bachelor's or Master's degree in Engineering, Computer Science, Information Technology, or a related field.
• Equivalent educational qualifications with relevant experience will also be considered.

Preferred Qualifications:

• Experience with real-time data processing and streaming technologies.
• Azure Data Engineering certifications are an added advantage.
• Strong analytical, problem-solving, and communication skills.
• Ability to work independently and in a collaborative environment.