Data Engineer (Databricks)
Xebia
You will be:
designing, building, and maintaining end-to-end data pipelines for client-facing measurement reports and licensed datasets,
operating and troubleshooting Apache Airflow DAGs supporting scheduled and on-demand data deliveries,
managing push-based delivery workflows (cloud storage, file transfers, delivery verification) Investigating and resolving production incidents across distributed systems (Airflow, databases, cloud storage),
implementing automation and AI-driven agents to streamline operational processes and data validation,
supporting custom delivery requests, including matching files, cross-reference datasets, and bespoke client configurations,
developing data quality and validation tooling to ensure accuracy before client delivery,
writing and maintaining database migrations for delivery configurations and client setups,
collaborating with product, engineering, measurement science, and client-facing teams,
documenting operational processes, runbooks, and delivery workflows.
Your profile:
2-4+ years of professional experience in Data Engineering, Software Engineering, or Operational Engineering,
experience with Databricks and PySpark for large-scale data processing,
strong proficiency in Python, including building and debugging data pipelines and automation scripts,
hands-on experience with Apache Airflow (DAG development, operators, troubleshooting),
very good knowledge of SQL, including complex joins, window functions, and JSON-based data,
experience working with cloud platforms (AWS and/or GCP),
upper-intermediate English,
readiness to work in a hybrid setup (in the Warsaw office once per week).
Nice to have:
experience with Unity Catalog,
experience with database migrations and schema/version management,
comfort working in environments with frequent production support and delivery deadlines,
experience building agentic or AI-driven automation workflows.
Work from the European Union region and a work permit are required.
Recruitment Process: CV review -HR Call - Interview - Client Interview - Decision
Benefits
Development:
development budget of up to 6,800 PLN,
we fund certifications e.g.: AWS, Azure, ISTQB, PSM,
access to Udemy, Safari Books Online and more,
events and technology conferences,
technology Guilds,
internal training,
Xebia Library,
Xebia Upskill.
We take care of your health:
private medical healthcare,
multiSport card - we subsidise a MultiSport card,
mental Health Support.
We are flexible:
flexible working hours,
B2B or permanent contract,
contract for an indefinite period.