Senior Data Engineer

You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients, designing and implementing big data and analytics solutions. Communication and organisation skills are key for this position, along with a problem-solving attitude.

Responsibilities:

• Develop data solutions within a Big Data Azure and/or other cloud environments.
• Work with divergent data sets that meet the requirements of the Data Science and Data Analytics teams.
• Build and design Data Architectures using Azure Data Factory, Databricks, Data Lake, and Synapse.
• Liaise with the CTO, Product Owners and other Operations teams to deliver engineering roadmaps showing key items such as upgrades, technical refreshes and new versions.
• Perform data mapping activities to describe source data, target data and the high-level or detailed transformations that need to occur.
• Assist the Data Analyst team in developing KPIs and reporting in tools, e. Power BI, Tableau.
• Data Integration, Transformation, Modelling.
• Maintaining all relevant documentation and knowledge bases.
• Research and suggest new database products, services and protocols.

Requirements:

• Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualisation tools: Tableau and PowerBI.
• Experience with cloud, container and microservice infrastructures.
• Experience working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams.
• Hands-on experience with data modelling, query techniques and complexity analysis.

Desirable Skills:

• Experience/Knowledge of working in an agile environment and experience with agile methodologies such as Scrum.
• Experience of working with development teams and product owners to understand their requirements.
• Certifications in any of the above areas will be preferred.

Essential Personal Traits:

• You should be able to work independently and communicate effectively with remote teams.
• Timely communication/escalation of issues/dependencies to higher management.
• Curiosity to learn and apply emerging technologies to solve business problems.