{"id":1075520,"url":"https://alion.io/job/job-mail-data-engineer-17","title":"Data Engineer","company":{"id":701519,"name":"Job Mail","domain":"jobmail.co.za","url":"https://alion.io/company/job-mail","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":true,"listed_via":"jobmail.co.za","ats_vendor":"Schema","truth_index":{"grade":"C","score":65,"open_postings":6893,"ghost_share":0.489,"stale_share":0,"repost_share":0.711,"time_to_fill_p50_days":7,"computed_at":"2026-10-22T06:10:10Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Johannesburg, South Africa"],"countries":["ZA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":37000,"max_usd":71000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":10},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ETL/ELT","optional":false},{"name":"Hadoop","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure","optional":true},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-09-20T10:11:42Z","employer_posted_date":"2026-10-22","last_verified_at":"2026-10-22T09:04:36Z","board_verified":false,"closed_at":null,"days_open":32,"trust":{"level":"ghost","repost_count":6,"flags":["repost"],"days_open":31},"description":"OverviewExpleo South Africa is where bold ideas meet real-world impact. As a global leader in engineering, quality services, and management consulting, we help businesses accelerate digital transformation and shape the future. Joining Expleo means more than just a job - it's an opportunity to grow, innovate, and collaborate on projects that redefine industries. From smart factories and next-generation banking to cutting-edge digital solutions, you'll tackle complex challenges alongside inspiring colleagues. At Expleo, your career isn't just developed - it's turbo-charged. Together, let's push boundaries and change the game.\nWe are seeking a highly skilled Data Engineer to join our team in Johannesburg (Hybrid).\nThe ideal candidate will be responsible for designing, developing, and maintaining our data infrastructure to ensure the efficient processing and storage of large datasets. This role involves collaborating with cross-functional teams to deliver high-performance data solutions, enabling informed decision-making across the organization. You will play a key role in optimizing data pipelines, ensuring data integrity, and implementing best practices for scalability and performance in a dynamic environment.\nResponsibilities\nData Pipeline Development:\nDesign, build, and maintain scalable, efficient, and reliable data pipelines using Ab Initio, ensuring data flows seamlessly between various systems.\nDevelop robust ETL (Extract, Transform, Load) processes to handle large volumes of data from diverse sources, enabling timely and accurate data delivery.\nContinuously improve and optimize pipeline architectures for future scalability and enhanced performance.\nData Integration and Management:\nIntegrate structured and unstructured data from multiple sources to create a unified and consistent data environment.\nEnsure the integrity, accuracy, and consistency of data across all platforms and systems, implementing validation processes and data quality checks.\nMaintain data management policies and procedures to ensure compliance with industry standards and organizational goals.\nPerformance Optimization:\nMonitor the performance of data pipelines and ETL workflows to identify bottlenecks and areas for improvement.\nImplement best practices for data storage, retrieval, and archiving to ensure fast and reliable access to critical information.\nUtilize performance-tuning techniques to optimize data transformations and processing, ensuring minimal downtime and efficient resource utilization.\nCollaboration and Communication:\nAct as a liaison between data scientists, business analysts, and other technical stakeholders to gather requirements and provide technical solutions that align with business objectives.\nCollaborate with cross-functional teams, including DevOps, system engineers, and business units, to ensure seamless data integration and project alignment.\nCommunicate complex technical concepts in a clear and understandable manner, facilitating better decision-making for stakeholders.\nTroubleshooting and Support:\nProactively identify, troubleshoot, and resolve data-related issues, including inconsistencies, discrepancies, and performance issues, to ensure smooth operations.\nProvide timely support for data-related queries and requests from various teams, offering insights and technical assistance to optimize workflows.\nMaintain and update documentation for data processes, ensuring that all procedures and solutions are well-documented for future reference.\nQualifications\nBachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.\nExperience\nRequired Experience:\n5+ years of experience in data engineering and ETL development.\nExtensive experience with Ab Initio, including developing and maintaining data pipelines.\nProficiency in SQL and other database technologies.\nExperience with big data technologies such as Hadoop, Spark, and Hive.\nKnowledge of data modeling, data warehousing, and data integration best practices.\nStrong problem-solving and analytical skills.\nExcellent communication and collaboration abilities.\nPreferred Experience:\nExperience with cloud platforms such as Azure.\nFamiliarity with scripting languages like Python or R.\nKnowledge of data governance and security practices","description_format":"text","description_chars":4290,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"South Africa","iso":"ZA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-20T10:44:22Z"},{"event":"close","at":"2026-09-20T14:25:31Z"},{"event":"reopen","at":"2026-09-21T10:16:46Z"},{"event":"close","at":"2026-09-21T13:46:58Z"},{"event":"reopen","at":"2026-09-23T10:25:26Z"},{"event":"close","at":"2026-09-23T14:29:54Z"},{"event":"reopen","at":"2026-09-24T10:51:15Z"},{"event":"close","at":"2026-09-24T16:07:27Z"},{"event":"reopen","at":"2026-09-27T10:44:53Z"},{"event":"close","at":"2026-09-27T16:28:42Z"},{"event":"reopen","at":"2026-09-29T09:45:44Z"},{"event":"close","at":"2026-09-29T19:33:07Z"},{"event":"reopen","at":"2026-10-03T08:40:27Z"},{"event":"close","at":"2026-10-03T16:24:22Z"},{"event":"reopen","at":"2026-10-04T10:11:14Z"},{"event":"close","at":"2026-10-04T14:15:09Z"},{"event":"reopen","at":"2026-10-05T09:22:56Z"},{"event":"close","at":"2026-10-05T13:49:34Z"},{"event":"reopen","at":"2026-10-06T09:50:46Z"},{"event":"close","at":"2026-10-06T12:41:50Z"},{"event":"reopen","at":"2026-10-07T08:25:38Z"},{"event":"close","at":"2026-10-07T11:53:10Z"},{"event":"reopen","at":"2026-10-09T09:12:44Z"},{"event":"close","at":"2026-10-09T17:17:37Z"},{"event":"reopen","at":"2026-10-10T08:40:16Z"},{"event":"close","at":"2026-10-10T12:18:17Z"},{"event":"reopen","at":"2026-10-11T09:21:43Z"},{"event":"close","at":"2026-10-11T13:00:04Z"},{"event":"reopen","at":"2026-10-13T09:38:29Z"},{"event":"close","at":"2026-10-13T20:08:06Z"},{"event":"reopen","at":"2026-10-14T09:13:31Z"},{"event":"close","at":"2026-10-14T13:37:05Z"},{"event":"restore","at":"2026-10-16T06:10:52Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":1,"p_active":0.126,"p_room":0.35,"age_days":31,"expected_fill_days":7,"reasons":["seen:7","repost:6","agency","wave","velocity","ghost","win:tail","comp:brand"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/job-mail-data-engineer-17","json_url":"https://alion.io/job/job-mail-data-engineer-17.json","meta":{"generated_at":"2026-10-23T05:40:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9260,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":701519},"rest":"https://alion.io/mcp/rest/get_company?id=701519"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fjob-mail-data-engineer-17"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fjob-mail-data-engineer-17"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fjob-mail-data-engineer-17"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/job-mail-data-engineer-17\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fjob-mail-data-engineer-17"}]}