ACQA Big Data Engineer | Krakow / Wroclaw
Kraków / Wrocław | 6+ years of experience | Hybrid - 3 days per week in the office
About the role
We are looking for an experienced Big Data Engineer / Software Engineer to join the ACQA platform team.
This is primarily a software engineering role with a strong focus on Big Data and cloud technologies, rather than a traditional data engineering position. You will be responsible for developing and supporting production-grade solutions using Scala, Java, Apache Spark and Azure Databricks, as well as building the platform capabilities and automation that enable other engineering teams to work effectively.
Responsibilities
Design, develop and maintain production-grade software using Scala, Java and Apache Spark
Develop and support Big Data solutions running on Azure Databricks
Build automation and tooling for managing Databricks environments
Enable multiple engineering teams to develop and operate Big Data solutions on the ACQA platform
Manage and enhance the Databricks platform, including monitoring and operational tooling
Define and implement best practices for platform and runtime upgrades
Develop and maintain CI/CD pipelines and automated deployment processes
Work with containerised development, build and runtime environments, including Kubernetes
Contribute to technical architecture and low-level design
Implement effective testing, observability, monitoring and alerting practices
Collaborate with globally distributed engineering teams and contribute to architectural and technical decisions
Requirements
6+ years of professional software engineering experience
Strong commercial experience with Scala and/or Java
Hands-on experience with Apache Spark and distributed data processing
Experience with Azure Databricks or a comparable Spark-based platform
Experience working with Microsoft Azure or another major public cloud provider
Experience developing or operating CI/CD pipelines, preferably using GitLab
Practical experience with containerisation and Kubernetes
Strong understanding of software engineering principles and production systems
Good communication and collaboration skills, with the ability to work effectively across multiple teams
Nice to have
Production experience with Terraform, preferably in an Azure environment
Python development experience
Experience with observability, instrumentation, monitoring and alerting
Knowledge of data structures, algorithms and information modelling
Experience with technical architecture and low-level design
Experience working in Agile development environments
Experience working in large, globally distributed engineering teams
About the project
ACQA is a strategic platform built on Microsoft Azure, providing next-generation valuation and risk management services across Front Office, Finance and Risk.
The platform is designed around scalable and cost-efficient cloud infrastructure, open architecture, automated data lineage and transparent cost management. It provides a shared technology platform that enables multiple teams to build and operate their solutions in a consistent and efficient way.
As part of the team, you will contribute both to the development of Big Data solutions and to the underlying platform, tooling and automation used by other engineering teams.
The ideal candidate
We are looking for a software engineer with a strong Scala and Spark background who is comfortable working with production systems, distributed technologies and cloud platforms.
A traditional data engineering background is not required. The role is particularly suited to someone who enjoys software development, distributed systems, automation and platform engineering, with hands-on experience in Spark and ideally Azure Databricks.
Working model
Hybrid - 3 days per week from the office
Locations: Kraków or Wrocław
Experience: 6+ years
If this opportunity matches your experience and you are interested in working on a large-scale cloud platform combining software engineering, Big Data and Azure technologies, we encourage you to apply!