Azure Data Engineer

Responsibilities:

• Design, build, and test scalable data platform solutions in Azure, leveraging tools like ADF, Databricks, and Function Apps, using Python.
• Develop high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.
• Collaborate closely with product and marketing teams to deliver data-driven insights and solutions that provide high business value.
• Write clean, maintainable code following best practices and development frameworks, ensuring robust data engineering standards.
• Continuously improve and optimise data workflows, monitoring performance and implementing enhancements to drive innovation.

Requirements:

• Experience in designing, building, and testing solutions within a data lakehouse environment.
• Proficiency in Python and PySpark for data processing and analytics.
• Strong SQL skills for querying and managing data.
• Hands-on experience with Azure, preferably ADF, Databricks, and Function Apps.
• Familiarity with CI/CD pipelines using Azure DevOps or similar tools.
• Ability to work within established development frameworks and adhere to coding standards.

Preferred:

• Strong teamwork skills, with a collaborative mindset and desire to learn from others.
• A proactive attitude with a passion for continuous learning and growth.
• High attention to detail and commitment to delivering quality work.
• Comfortable working in a fast-paced environment, with the ability to estimate tasks and deliver incremental value effectively.

Skills

ADF, Databricks, SQL, azure, pyspark, python