Senior Databricks Data Engineer

We are seeking an experienced Databricks Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong technical expertise in Databricks, Python, PySpark, and SQL, with experience delivering reliable, high-performance data engineering solutions.

Key Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines using Databricks
• Build and optimise data processing solutions using Python, PySpark, and SQL
• Work with Apache Spark, Delta Lake, and Lakehouse architecture
• Integrate data from multiple sources into cloud-based data platforms
• Implement data quality checks, security controls, and governance standards
• Troubleshoot pipeline issues and optimise performance
• Collaborate with data analysts, architects, and business stakeholders

Minimum Requirements

• At least 5 years of relevant data engineering experience.
• Strong hands-on experience with Databricks, Python, PySpark, and SQL
• Experience with Apache Spark, Delta Lake, and ETL/ELT processes
• Experience with at least one cloud platform: Azure, AWS, or GCP
• Knowledge of data modelling, data warehousing, and data quality
• Strong analytical and problem-solving skills
• Must be based in Johannesburg or able to work there as required
• Must have a valid South African ID

Advantageous

• Databricks Data Engineer certification
• Experience with CI/CD, Git, and workflow orchestration tools
• Relevant degree or diploma in IT, Computer Science, or a related field