First seen by Alion on Sep 30, 2026.
Work mode: Hybrid from Krakow 3 days/week
Role Summary
We are looking for an experienced Senior Data Engineer with 7+ years of experience in data engineering and Python development. The ideal candidate will have strong hands-on expertise in Databricks, PySpark, SQL, Delta Lake, FastAPI, Structured Streaming, and Unity Catalog migration.
Experience in the BFSI domain and exposure to Azure, CI/CD, and technical leadership will be an added advantage.
Key Skills - Must Have
Strong experience in Data Engineering and Python development.
Hands-on expertise in FastAPI, including API development, integration, enhancement, and maintenance.
Extensive experience with Databricks, PySpark, SQL, and Delta Lake.
Proven experience with Unity Catalog migration and Databricks data governance.
Strong hands-on experience with Databricks Structured Streaming and real-time data processing.
Experience working with Oracle, SQL Server, and Informatica.
Ability to independently design, develop, and implement scalable and high-performance data engineering solutions.
Good understanding of the Banking, Financial Services, and Insurance (BFSI) domain.
Additional / Preferred Skills
Experience with Microsoft Azure Cloud and Databricks administration.
Hands-on experience with CI/CD, Git, Azure DevOps, and/or GitLab.
Strong understanding of Apache Spark performance tuning and optimization.
Experience providing technical leadership, mentoring engineers, and managing stakeholder communication.
Databricks certifications would be an added advantage.
Key Responsibilities
Design, develop, enhance, and maintain FastAPI-based services, APIs, and integrations.
Build and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, SQL, and Delta Lake.
Lead and contribute to Unity Catalog migration and broader data modernization initiatives.
Design and implement real-time data processing and streaming solutions using Databricks Structured Streaming.
Perform Spark and Databricks performance tuning to improve scalability, reliability, and processing efficiency.
Integrate and work with enterprise data sources including Oracle, SQL Server, and Informatica.
Ensure solutions follow enterprise standards for data quality, security, governance, scalability, and reliability.
Collaborate closely with business stakeholders, data architects, engineering teams, and vendors to deliver enterprise-grade data solutions.
Provide technical guidance, contribute to solution architecture, and support the delivery of complex data engineering initiatives.
Troubleshoot production issues and drive continuous improvement of data platforms and services.
Sounds like you? Looking forward to hearing from you! :)

