{"id":1450109,"url":"https://alion.io/job/simplify-hr-proprietary-limited-senior-databricks-data-engineer","title":"Senior Databricks Data Engineer","company":{"id":1891733,"name":"Simplify HR","domain":"simplify.hr","url":"https://alion.io/company/simplify-hr","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":{"grade":"B","score":75,"open_postings":375,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":49,"computed_at":"2026-10-02T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["South Africa"],"countries":["ZA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":32000,"max_usd":67000,"period":"year","method":"role_seniority_country_cell","sample_n":8},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Clean Architecture","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Machine Learning","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-09-09T00:00:00Z","employer_posted_date":"2026-09-23","last_verified_at":"2026-09-29T13:23:43Z","board_verified":false,"closed_at":null,"days_open":24,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":24},"description":"Position: Senior Databricks Data Engineer\n\n(Hybrid/Pinelands, Cape Town)\nConfluent Services, South Africa’s largest and multi-award winning debt management company, has a position available for a Data Engineer.\nThis individual will join the Data Team and will be accountable for data engineering design, data ingestion and support across on-premise and cloud-based platforms.\nWhat’s in it for you?\nBeing South Africa’s largest company of its kind, Confluent is continuously growing, with no signs of stopping. At Confluent, we build on current-generation platforms like Databricks and Microsoft Fabric, giving you hands-on exposure to tools and patterns that are shaping the future of data engineering. This is not a legacy maintenance role, you’ll be involved in designing, building, and evolving data solutions from the ground up, with real room for creativity and engineering judgement.\nYou’ll work alongside a team of high caliber senior data engineers, where knowledge sharing is part of how we operate. Technical discussions are encouraged, opinions are respected, and decisions are driven by merit rather than hierarchy. Our team is actively involved in AI and machine learning initiatives, giving you exposure beyond traditional data pipelines.\nWe value clean architecture, thoughtful design, and creativity. You will have the opportunity to influence how things are built, contribute to architectural decisions, and help shape the evolution of our data platform.\nCulturally, we are a diverse, respectful, and collaborative team. We invest in people, support continuous learning, and create an environment where engineers can grow both technically and professionally. Whether you want to deepen your engineering expertise or broaden your impact across the business, you’ll find room to do so here.\nBeyond the work itself, Confluent offers a stable, growing environment where the data you build helps real South Africans improve their financial outcomes, giving purpose and impact to the systems you design.\nOther key benefits:\nWe have a vibrant office in a lively part of the city, meaning you have easy access to stores and outlets if you need. \nWe offer company benefits - medical aid, retirement annuity, Bursaries and Insurance \nWe have a culture of growth, meaning you have access to move both upwards or across in the business if you want to. \nRequirements\nCandidates must be able to demonstrate:\nMinimum 3 years experience as a data engineer or in a similar role, designing and implementing data pipelines, data integration and ETL processes. \nPractical experience in Azure, Azure Data Factory and Azure Databricks is preferred.\nProven experience in Python/PySpark and SQL/SparkSQL programming skills. \nAt least 3 years of experience in Information Technology - specifically in technical data roles e.g. data engineering, data analytics or data science. \nKnowledge of data management and storage solutions, including SQL Server Database, Azure Data Lake Storage or similar. \nHaving good communication skills and being able to operate in a team environment. \nExcellent attention to detail and problem-solving skills related to data, data structures and algorithms. \nKey responsibilities will include:\nContribute to the architecture and design of the Confluent Data Platform and ingestion patterns. \nImplement and support the scalable data solutions on the Microsoft Azure cloud platform, including Azure Databricks. \nDevelop, maintain and optimise robust production data pipelines for data ingestion, processing, and transformation to support analytics, machine learning and other downstream data-driven services. Ensure data security, quality and integrity across all of the pipelines and related data processes. \n\nCollaborate with the data product owner, analysts, data scientists, and business stakeholders to understand data requirements and implement effective data workflows. \nAssist in data initiatives and support technical teams including architects, analysts, software developers, and data scientists. \nQualifications:\nBachelor's degree in Computer Science, Engineering, or a related field. \nCertifications in Azure, Microsoft Fabric Data Engineering, Azure Databricks Data Engineering or similar or equivalent practical experience.","description_format":"text","description_chars":4256,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"South Africa","iso":"ZA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services","Human Resources","Recruiting Software & ATS"],"lifecycle":[{"event":"open","at":"2026-09-29T07:41:21Z"}],"liveness":{"score":48,"band":"ok","label":"Likely open","p_open":0.9,"p_active":0.595,"p_room":0.9,"age_days":23,"expected_fill_days":49,"reasons":["conf:64","stale_co","velocity","win:mid","comp:brand"],"computed_at":"2026-10-02T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/simplify-hr-proprietary-limited-senior-databricks-data-engineer","json_url":"https://alion.io/job/simplify-hr-proprietary-limited-senior-databricks-data-engineer.json","meta":{"generated_at":"2026-10-03T04:10:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":4318,"day_limit":5000,"remaining_today":682,"minute_limit":60,"resets_at":"2026-10-04T00:00:00Z"}}}