Tech Lead Data Consultant

Type of contract: B2B contract

Salary range: 155-205 PLN/H

What will you do?

Join a strategic data transformation initiative focused on building and enhancing a large-scale data pipeline that feeds and reconciles inbound data from deal stores to consumer regulatory and settlement systems. You will work on modernizing enterprise-grade financial services platforms within a highly regulated environment, leveraging cloud-native technologies, big data solutions, and distributed streaming architectures. The role involves designing high-performance systems, improving data processing capabilities, and collaborating closely with technical and business stakeholders.

Your tasks

• Design and develop scalable data processing solutions using Spark and Databricks
• Build and enhance data pipelines using PySpark, Python and Java
• Develop high-performance, high-availability distributed systems
• Implement and maintain streaming solutions based on Kafka architectures
• Design and optimize cloud-native solutions in Microsoft Azure
• Support CI/CD processes and DevOps practices
• Collaborate with cross-functional Agile teams to deliver business requirements
• Analyze complex technical flows and propose suitable technical solutions
• Participate in system modernization and application transformation initiatives
• Ensure reliability, scalability and performance of data platforms

Requirements

• 7+ years of professional software engineering or data engineering experience
• Strong experience with Spark and Databricks
• Hands-on experience with PySpark
• Strong Python programming skills
• Good Java development experience
• Deep knowledge of Microsoft Azure cloud technologies
• Experience with Kubernetes
• Experience designing and implementing Kafka-based streaming solutions
• Experience with DevOps practices and CI/CD pipelines
• Experience building distributed, high-throughput and low-latency systems
• Strong problem-solving and analytical skills
• Ability to work independently on complex technical challenges
• Excellent communication and stakeholder management skills
• Experience working in Agile teams
• Openness to work hybrid from our client's office (Kraków) 3 days a week

Nice to have

• Experience providing Level 3 (DEV) production support in a high-pressure environment