Senior Data Engineer

For our client in the travel and cruise industry, we are looking for an experienced Senior Data Engineer to design, develop, and maintain scalable data solutions within the Azure Data Platform ecosystem. The role involves working with modern Lakehouse architecture, developing and optimizing data pipelines, and supporting data platform modernization initiatives in an international environment.

Location: 100% remote

Cooperation model: B2B

Rate: 130-150 PLN/h net

Tech Stack: Python, SQL, Apache Spark, Azure Cloud, Azure Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Data Explorer, Delta Live Tables (DLT), Unity Catalog, Lakehouse Architecture, Power BI, Azure DevOps, CI/CD, ETL/ELT.

Wymagania

• Experience as a Data Engineer working with modern data platforms,

• Strong knowledge of Python, SQL, and Apache Spark,

• Hands-on experience with Azure Cloud and Azure Databricks,

• Experience with Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Data Explorer,

• Experience in building and maintaining ETL/ELT processes,

• Practical knowledge of Delta Live Tables (DLT) and Unity Catalog,

• Understanding of Lakehouse architecture and data platform design principles,

• Experience with CI/CD and Azure DevOps,

• Knowledge of infrastructure automation, monitoring, and logging,

• Strong analytical and problem-solving skills,

• Ability to work independently, take ownership, and proactively identify areas for improvement,

• Strong communication skills and the ability to collaborate with technical teams and business stakeholders,

• English proficiency at B2+ level, enabling effective communication in an international environment.

Obowiązki

• Designing, developing, and maintaining scalable data solutions within the Azure Data Platform ecosystem,

• Building and optimizing ETL/ELT pipelines for data ingestion, transformation, and delivery,

• Developing data processing solutions using Python, SQL, and Apache Spark,

• Working with Azure Databricks, Azure Synapse Analytics, and Azure Data Lakehouse environments,

• Developing and maintaining Databricks workflows, Delta Live Tables (DLT), and data orchestration processes,

• Supporting platform modernization initiatives, including Unity Catalog adoption and platform upgrades,

• Collaborating with Data Architects, analysts, and business stakeholders to translate business requirements into technical solutions,

• Ensuring data quality, reliability, performance, and security across the data platform,

• Troubleshooting production incidents, performing root cause analysis, and implementing corrective actions,

• Contributing to CI/CD, infrastructure automation, monitoring, and logging,

• Optimizing data pipelines, storage structures, and processing workloads to improve efficiency and reduce costs,

• Supporting data governance and engineering best practices,

• Providing reliable data foundations for reporting, analytics, and AI/ML initiatives,

• Sharing knowledge and supporting the technical development of the team.

Oferujemy

• 100% remote work,

• B2B cooperation with a rate of 130-150 PLN/h net,

• A comprehensive private medical care package,

• Access to the MyBenefit cafeteria platform,

• Flexible payment arrangements,

• A short 14-day invoice payment term,

• Long-term cooperation.