Data Warehouse Consultant (Integration Lead)
Want to make an impact? We offer that
Due to continued growth, we are hiring a Database Warehouse Consultant to join our client in the public sector. You will be responsible for the design, development and implementation of an enterprise-level data integration solution, supporting the Core Analytics Platform and broader Data Strategy.
Key Responsibilities:
· Lead the development of the integration layer within the Microsoft Fabric environment, including the design and implementation of scalable, reusable data pipelines, dataflows and ingestion frameworks.
· Design and implement end-to-end data integration processes across multiple systems, including operational applications (e.g. Portal and Case Management System).
· Develop and maintain robust data ingestion, transformation and orchestration pipelines using Fabric Data Factory, Azure Data Factory and associated technologies.
· Implement and manage a data monitoring and logging framework, including:
o Pipeline monitoring and alerting
o Data processing logs and exception handling
o Proactive identification and resolution of data issues
· Define and implement data validation, reconciliation and data quality controls, ensuring accuracy, completeness and consistency of integrated data.
· Design and implement data cleansing, standardisation and transformation processes to support trusted, high-quality data outputs.
· Deliver and maintain integration solutions for hybrid environments, including:
o Data movement between on-premise and Azure platforms
o Log shipping, replication and high-availability data transfer mechanisms
o Support for near real-time and batch integration patterns
· Work closely with Data and ICT teams to define integration standards, patterns, and best practices, including documentation of all pipelines, interfaces and data flows.
· Support the ongoing enhancement, optimisation and operation of integration services, ensuring scalability, performance and reliability.
· Provide technical guidance, knowledge transfer and support teams in relation to integration architecture and data engineering best practices.
Requirements:
· 7+ years' experience working in similar role
· Bachelor's degree in computer science, information technology, or a related
· Industry certifications in data analytics, governance, engineering etc.
· Enterprise Data Integration & Architecture
o Demonstrated experience designing and delivering enterprise-scale data integration solutions across complex system landscapes
o Strong understanding of integration architectures, including batch, near real-time and event-driven patterns
o Proven ability to define and implement integration standards, frameworks and governance controls
· Microsoft Fabric & Data Engineering
o Strong experience working within Microsoft Fabric, including: Fabric Data Factory / Data Pipelines and Lakehouse and Warehouse integration layers
o Experience building end-to-end data pipelines and orchestration workflows
o Understanding of Delta Lake and modern data platform architectures
· ETL/ELT, Data Pipelines & Hybrid Integration
o Proven experience in ETL/ELT design and implementation using technologies such as: Azure Data Factory (ADF)/Fabric pipelines and dataflows
o Experience integrating cloud and on-premise systems, including secure data movement mechanisms
o Practical experience implementing log shipping, replication, and data synchronisation solutions
· Data Quality, Validation & Monitoring
o Strong experience implementing data quality frameworks, including: Data profiling, cleansing, standardisation and transformation, as well as, Data validation, reconciliation and exception handling
o Experience designing and managing monitoring, logging and alerting frameworks for data pipelines
o Ability to identify, troubleshoot and resolve data integration and processing issues
· Database & Data Platform Expertise
o Experience working with enterprise data platforms, including: Azure SQL, SQL Server (on-premise)
o Proven ability to design and optimise data integration solutions for performance and scalability
o Strong SQL and data manipulation skills
Opportunity type: Initial 12-month contract (possibility of extension), Hybrid in Dublin
Start date: November 2026