Data Engineer | Wroclaw
First seen by Alion on Sep 26, 2026.
We are looking for a Data Engineer with strong hands-on experience in Azure Data Factory (ADF) to join a long-term project with a major international Swiss investment bank. Experience with Azure Databricks (ADB) will be considered a significant advantage.
Location: Wroclaw&Krakow, hybrid 3-4 days/week
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Python.
Build and optimize ETL/ELT workflows for processing large volumes of data.
Write efficient, reusable, and high-performance code with a strong focus on optimization.
Process and manage structured and unstructured data from multiple sources.
Implement best practices related to data engineering, performance tuning, and code quality.
Develop, orchestrate, and monitor data workflows using Azure Data Factory (ADF).
Collaborate with Data Scientists, Data Analysts, Solution Architects, and other stakeholders.
Ensure data quality, reliability, and integrity across all data platforms.
Troubleshoot and resolve performance bottlenecks in data processing pipelines.
Contribute to data architecture discussions and continuous improvement initiatives.
Required Skills & Experience
6-10 years of overall IT experience.
4-5 years of hands-on experience inPySpark and Python development.
Strong understanding of data engineering principles and modern data pipeline architectures.
Proven expertise in:
PySpark (Spark SQL, DataFrames, performance tuning)
Python scripting and application development
Azure Data Factory (ADF) orchestration and pipeline development
Strong knowledge of data optimization techniques, including partitioning, caching, joins, and query optimization.
Experience working with large-scale distributed data processing systems.
Strong analytical and problem-solving skills.
Good understanding of SQL, database concepts, and data modeling.
Nice-to-Have Skills
Hands-on experience with Azure Databricks (ADB).
Exposure to cloud technologies, preferably Microsoft Azure.
Experience with CI/CD pipelines and DevOps practices for data engineering.
Knowledge of Data Lake and Lakehouse architectures.
Familiarity with modern data governance and monitoring practices.
Benefits
Stable long-term cooperation with opportunity for extension
Opportunity to work with modern technologies in an international environment
Professional growth and continuous development opportunities
Participation in challenging and impactful projects
If you're interested and meet the qualifications, please send your CV at [email protected]