Lead Data Engineer

We are looking for a Lead Data Engineer with strong experience in building scalable data platforms and driving data engineering initiatives. In this role, you will work closely with stakeholders to design, develop, and optimise data pipelines and analytics platforms. You will play a key role in building a robust data infrastructure, ensuring data quality, and enabling data-driven decision-making across the organisation. This role requires both strong technical expertise and leadership capabilities to guide teams and drive execution.

Responsibilities:

• Design and develop scalable data engineering platforms and pipelines.
• Build and manage robust ETL pipelines and data workflows.
• Implement data modelling solutions, including data marts and warehousing.
• Develop and optimise big data processing systems using modern tools and frameworks.
• Build and manage data lakes and analytics platforms on AWS Cloud.
• Ensure data quality, security, and governance across systems.
• Work with APIs to create, read, transform, and store data in structured formats.
• Collaborate with cross-functional teams to drive data initiatives and business outcomes.
• Contribute to product vision and help drive the data engineering roadmap.

Requirements:

• 7-11 years of experience in developing platforms in data engineering.
• Hands-on experience with SQL, ETL pipelines, and data modelling/marts.
• Strong technical expertise in tools/languages such as SQL, Scala, Python, R, Java, Snowflake, Spark, Apache Airflow, Redash, Tableau, etc.
• Solid understanding of data engineering best practices: data integration, data security, data warehousing, data analytics, metadata management, and data quality.
• Experience in implementing big data analytics platforms and data lakes using AWS Cloud services.
• Adept at articulating product vision and driving the future roadmap with strong business acumen.
• Knowledge of cloud technologies (AWS), CI/CD, Jenkins, and testing methodologies is preferred.
• Strong leadership skills, including hiring, mentoring, and retaining data engineering talent.
• Excellent written and verbal communication skills.
• Experience with Scrum or Agile development methodologies.

Skills

AWS, Amazon Web Services, ETL, Python, SQL, Scala, Snowflake, Spark