Data Engineer

IVC Evidensia is undergoing an exciting digital transformation. The key to this is improving the management of our core data sets - accelerating the standardisation of operational systems in practices, building stronger master data management tooling, and developing standard reporting models across the group.

As a data engineer, you will work with the team to advance the data platform within a DevOps culture. You will play a central role in building and maintaining scalable data pipelines across Databricks & Azure SQL Server, and will bring solid experience with ELT, orchestration, and scripting languages. A firm grasp of data modelling and management will be essential throughout.

The role

The Data Engineer will be a technical authority accountable for the design and development of the technologies that underpin our data strategy. At the heart of this is our Databricks data platform, and you will take ownership of building, optimising, and maintaining data pipelines using PySpark - orchestrating feeds from source systems through to our group data platform and taking technical ownership of all parts of the process.

You will work closely with the business to deliver solutions that address real challenges, engaging with SMEs to break requirements into deliverables. You will also collaborate with the Data Architect to shape our overarching data management strategy.

What you'll bring to the role

We're looking for a technically skilled and business aware individual with a strong understanding of data concepts, including storage, processing, and modelling. Core requirements include:

• Databricks - hands-on experience building and managing workloads on the Databricks platform, including Delta Lake, Unity Catalog, and Declarative Automation Bundles
• PySpark - proficiency in writing and optimising PySpark code for data transformation and processing
• Azure - solid experience working within the Azure ecosystem, including services such as Azure Data Factory, Azure Data Lake Storage, and Azure DevOps
• Azure SQL Server - experience with Azure SQL Server is important, as it forms the foundation of our existing data warehouse. You will be working across both our SQL Server environment and our Databricks platform, and an understanding of how the two integrate will be key to success in this role
• ELT & pipeline development - experience designing and maintaining pipelines using REST APIs, JSON, and ELT protocols
• Data modelling - comfort working with both relational and non-relational data technologies, with a solid grounding in modelling principles

Exposure to business intelligence tools like Power BI is desirable. You'll act as a key interface between IT and functions such as Finance and Marketing, so excellent communication and stakeholder engagement skills are vital.

You should be confident working within an Agile framework, with an understanding of secure development practices and non-functional requirements such as scalability, performance, and access management. An international mindset, sensitivity to local business priorities, and a collaborative approach are essential.