Data Engineer (12-Month Contract)

An opportunity is available for an experienced Data Engineer to join a dynamic data engineering team. The successful candidate will be responsible for combining software, systems and data to extract meaningful insights from raw data, ensuring data availability, integrity and optimal performance.

The role involves working closely with data scientists, analysts and other stakeholders to design, develop and maintain data integration pipelines, data layers and data warehouse solutions. The ideal candidate will have strong ETL and data warehouse experience, sound SQL and programming skills, and exposure to cloud platforms.

Client and Requirement Analysis

• Understand and analyse client requirements and business needs.

• Identify, analyse, visualise and interpret supporting data to propose effective solutions.

Design and Development

• Design and develop data layers to support Big Data analytics.

• Architect data integration pipelines and ensure successful extraction, transformation and loading (ETL) of data from various sources.

• Analyse specifications and data to design data warehouse and product layers.

• Develop, test and maintain data pipelines and layers, ensuring quality and optimal performance.

• Create and maintain technical documentation.

• Support existing solutions within GCP and Oracle environments.

• Conduct peer reviews and comply with SDLC processes and documentation standards.

Team Collaboration and Support

• Participate actively in the product team, providing cross-training and mentorship where required.

• Collaborate with data scientists, analysts, stakeholders and the wider team.

• Provide timely project and task status updates.

• Log change requests and accurately record time.

• Participate in standby rotations.

Quality and Operational Management

• Take responsibility for delivering quality solutions that provide business value.

• Drive ticket progress and ensure timely resolution.

• Manage GCP costs and related IT responsibilities.

• Ensure the successful creation and maintenance of infrastructure required for the extraction, transformation and loading of data from a wide variety of sources.

• Bachelor's degree in Computer Science, Information Technology, Engineering or a related field.

• 4–6 years' experience in data warehousing and ETL.

• Knowledge of cloud platforms such as AWS, Azure or Google Cloud and their associated data services.

• Strong SQL skills and experience working with relational databases such as Oracle, PostgreSQL, MySQL or SQL Server.

• Experience with dimensional modelling and data analysis.

• Understanding of version control systems such as SVN or GIT.

• Proficiency in programming languages and scripting, including Python, Java, Korn shell scripting and SQL.

• Broad understanding of different Software Development Life Cycles (SDLCs).

• Exposure to Agile methodologies.

• Experience with data visualisation tools and exposure to the retail industry would be advantageous.

Key Competencies

• Ownership and accountability.

• Strong problem-solving and critical-thinking abilities.

• Effective planning and organisational skills.

• Excellent attention to detail and communication skills.

• Ability to manage multiple tasks and adapt to changing priorities in a fast-paced environment.

• Curiosity and an interest in analysing problems and developing solutions.

• Strong teamwork and collaboration skills.

• Self-driven, with a passion for new technologies.