Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, develop and maintain scalable data infrastructure and pipelines that support business intelligence, advanced analytics and AI-driven initiatives.

The successful candidate will play a key role in building modern data platforms, optimising data processing workflows and ensuring the availability, quality and security of enterprise data.

You will work closely with data architects, data scientists, analytics teams and business stakeholders to deliver high-performance data solutions.

Key Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines.

• Build and optimise data warehouses, data lakes and lakehouse architectures.

• Develop complex data transformations using Python, SQL and PySpark.

• Implement and manage cloud-based data solutions.

• Ensure data quality, governance, security and reliability.

• Optimise data processing performance and troubleshoot pipeline issues.

• Develop and maintain batch and real-time data processing solutions.

• Collaborate with Data Scientists, BI Developers and Data Architects.

• Implement CI/CD practices and automated testing for data pipelines.

• Mentor junior and intermediate Data Engineers.

• Contribute to data architecture and technical design decisions.

Technical Requirements

Skill / Technology Required experience

Python

Advanced

SQL / T-SQL

Advanced

Apache Spark / PySpark

Advanced

Azure / AWS / GCP

Strong

ETL / ELT

Advanced

Data Warehousing

Strong

Data Lake / Lakehouse

Strong

Databricks

Advantageous

Snowflake

Advantageous

Microsoft Fabric

Advantageous

Azure Data Factory

Advantageous

Apache Kafka

Advantageous

Airflow / Prefect

Advantageous

Git / CI/CD

Strong

Data Governance

Strong

Minimum Requirements

• Bachelor's degree in Computer Science, Information Systems, Data Engineering or a related field.

• 6–10+ years of experience in Data Engineering.

• Proven experience designing and implementing enterprise-scale data solutions.

• Strong programming and database development skills.

• Experience working with cloud-based data platforms.

• Understanding of data modelling, data architecture and distributed computing.

• Excellent problem-solving and communication skills.