Senior Data Engineer

Job Type:

Build a brilliant future with Hiscox

Role Overview:

We are seeking an experienced Senior Data Engineer to design, build, and maintain enterprise data pipelines and data solutions across our Microsoft-centric platform. This hybrid role combines hands-on technical expertise with a strong focus on data governance, quality, and collaboration.

Key Responsibilities:

• ETL/ELT Pipelines: Design, develop, and maintain robust ETL/ELT pipelines ensuring data is efficiently extracted, transformed, and loaded across systems.
• Data Engineering Projects: Lead data refactoring and integration projects across the platform, optimising data flows and performance.
• Documentation & Governance: Maintain high-quality documentation for data pipelines and architecture. Contribute to data governance initiatives to ensure data quality, security, and compliance.
• Cross-Team Collaboration: Work closely with Dynamics 365, Power Platform, and other cross-functional teams to deliver integrated data solutions. Engage stakeholders to understand requirements and provide technical guidance.

Essential Skills & Experience:

• Database Proficiency: Deep expertise in Microsoft SQL (T-SQL) - able to write, optimise, and troubleshoot complex queries and stored procedures.
• Azure Data Factory (ADF): Hands-on experience developing and orchestrating pipelines with Azure Data Factory.
• Dynamics 365 & Power Platform: Proven experience working with Microsoft Dynamics 365 and the Power Platform ecosystem.
• Dataverse: Strong experience with Microsoft Dataverse (Common Data Service) - including data modelling and integration. (This is essential or a very strong advantage.)
• Data Architecture: Solid understanding of data modeling, data warehousing concepts, and ETL best practices in a cloud environment.
• Collaboration & Communication: Excellent communication skills with the ability to translate complex data concepts for technical and non-technical stakeholders. Team-oriented, proactive in knowledge sharing, and adept at documentation.
• Problem-Solving: Demonstrated ability to troubleshoot data issues, optimise performance, and ensure reliability and accuracy of data pipelines.

Desirable Skills:

• Microsoft Fabric: Experience with Microsoft Fabric (Azure) for advanced analytics and data integration.
• Cloud Analytics: Familiarity with Azure Synapse Analytics or Azure Data Lake for big data processing and warehousing.
• Scripting & Automation: Proficiency in a programming/scripting language (e.g., Python or C# PowerShell) for advanced data transformation and automation.
• CI/CD & DevOps: Experience implementing CI/CD pipelines and version control (e.g., Azure DevOps, Git) for data engineering projects.
• Data Quality & Governance Tools: Experience using data quality frameworks or data governance tools to enforce standards and compliance.

Nice-to-Have Skills:

• Big Data Tools: Exposure to Azure Databricks
• BI & Reporting: Knowledge of Power BI or similar data visualisation/BI tools for supporting analytics and reporting needs.
• ML Pipelines: Basic understanding of machine learning pipelines or model deployment in a data engineering context.

Other Information:

• Work Arrangement: This position is based in Lisbon with a hybrid working model (on-site at our Lisbon office approximately two days per week).
• Mindset: The ideal candidate is detail-oriented, self-driven, and passionate about clean, well-governed data. They thrive in a collaborative environment and take ownership of delivering high-quality solutions.

Work with amazing people and be part of a unique culture