Data Engineer (Databricks)

In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are looking for a Data Engineer to join a client project focused on building and optimizing modern data platforms on Azure and Databricks. The role involves designing, developing, and maintaining scalable data pipelines, processing large volumes of data, and supporting business-critical analytics solutions.

Project information:

• Type of project: IT Services

• Office location: Warsaw

• Work model: Hybrid mode - 2 days per week in the office in Warsaw

• Budget: 140 - 153 PLN net/ h - b2b

• Project length: till the end of 2026, possible to extend it

• Only candidates with citizenship in the European Union and residence in Poland

• Start date: ASAP

Project scope:

• Build and optimize modern data platforms on Azure and Databricks

• Design, develop, and maintain scalable data pipelines

• Build and optimize data lakehouse solutions supporting analytics, reporting, and regulatory needs

• Implement data ingestion from multiple sources (databases, APIs, files, messaging/ event streams)

• Perform data transformation, validation, and quality checks across end-to-end data flows

• Collaborate with Business Analysts and stakeholders to translate requirements into data solutions

• Support production environments, handle incident analysis, and contribute to performance optimization

• Ensure compliance with data governance, security, and regulatory standards

Competence demands:

• Min 4 YoE in Data Engineering

• 2+ years of hands-on experience with Databricks and Delta Lake in production environments

• 2+ years of experience developing and maintaining Azure Data Factory (ADF) pipelines

• Very strong Python, Spark SQL, PySpark programming skills

• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2)

• Knowledge of Medallion architecture, dimensional models

• REST APIs, batch and streaming ingestion

• GitHub Copilot, CI/CD pipelines, Azure DevOps or similar

• Strong understanding of data quality, performance tuning, and scalability

• Strong understanding of data modeling, ETL/ELT processes, and modern data architecture principles

• Very good English skills

Nice to have:

• PostgreSQL integration

• Time-series data processing (GPS/parameter data)

• Slowly Changing Dimensions (SCD) patterns

• Spark performance tuning (SLA-driven optimization)

• Adaptive Query Execution (AQE) configuration

• CDC (Change Data Capture) and incremental loading

• SSIS migration patterns

We offer:

• Hybrid working model

• Dynamic and innovation-driven engineering environment

• Full-time job agreement based on b2b

• Private medical care with dental care (covering 70% of costs)

• Multisport card (also for an accompanying person)

• Life insurance