Senior Data Engineer (Databricks)
About the role
We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions.
Responsibilities:
Design, develop and maintain scalable ETL/ELT pipelines
Build reliable batch and streaming data processing solutions
Develop data pipelines using Databricks and Apache Spark
Optimize Spark jobs and improve platform performance
Work with Delta Lake and Medallion Architecture
Build and maintain data models for analytics and reporting
Ensure data quality, monitoring and observability
Collaborate with Architects, Data Scientists and Analytics teams
Participate in code reviews and technical improvements
Contribute to CI/CD processes and engineering best practices
Requirements:
5+ years of experience in Data Engineering
2+ years of commercial experience with Databricks
Strong knowledge of PySpark and Spark SQL
Excellent SQL skills
Strong Python programming skills
Experience building ETL/ELT pipelines
Experience working with Delta Lake
Good understanding of Medallion Architecture
Experience with cloud environments (Azure, AWS or GCP)
Experience with Git and CI/CD
Understanding of data modelling principles
Good communication skills
Fluent English - C1
Nice to have:
Unity Catalog experience
dbt
Kafka or Structured Streaming
Airflow or Databricks Workflows
Databricks certification
Experience with performance tuning and cost optimization