Specialist - Data Engineering

Job Summary

Seeking a Specialist with 5 to 7 years of experience in Azure Cloud Architecture and Azure Databricks to design and implement scalable data solutions within the Azure ecosystem

Job Description

Design develop and optimize endtoend data pipelines using Azure Databricks to support complex data processing and analytics scenarios Architect and maintain secure scalable data storage and processing solutions leveraging Azure Cloud services Collaborate with crossfunctional teams to align data solutions with business objectives and technical requirements Implement best practices for data governance security and compliance within Azure environments Ensure high availability performance and reliability of data platforms through continuous monitoring and tuning Utilize strong expertise in Azure Cloud Architecture to provision and manage Azure resources effectively Apply advanced Databricks concepts including security production architecture and pipeline development Leverage Python and Spark SQL skills for efficient data ingestion and transformation workflows

Roles and Responsibilities

Lead design and implementation of Azurebased data integration and processing platforms focusing on Azure Databricks

Mentor and guide data engineers on best practices and technical solutions within Azure Databricks and Azure Cloud

Collaborate with stakeholders to gather requirements and translate them into scalable technical architectures

Oversee data migration transformation and integration activities ensuring seamless data flow

Establish and enforce data architecture standards policies and procedures to maintain data quality and security

Conduct performance tuning troubleshooting and optimization of data pipelines

Manage Azure resource provisioning and configuration aligned with security and compliance standards

Keep abreast of emerging Azure data technologies and tools to drive innovation and improve platform capabilities