{"id":3563549,"url":"https://alion.io/job/job-mail-senior-data-engineer-18","title":"Senior Data Engineer","company":{"id":701519,"name":"Job Mail","domain":"jobmail.co.za","url":"https://alion.io/company/job-mail","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":true,"listed_via":"jobmail.co.za","ats_vendor":"Schema","truth_index":{"grade":"C","score":65,"open_postings":6928,"ghost_share":0.489,"stale_share":0,"repost_share":0.71,"time_to_fill_p50_days":7,"computed_at":"2026-11-01T06:10:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Centurion, South Africa"],"countries":["ZA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":33000,"max_usd":61000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":13},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-31T07:12:17Z","employer_posted_date":"2026-10-31","last_verified_at":"2026-10-31T07:12:17Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"The reporting is only as good as the pipeline underneath it. This role owns that layer: the ingestion, the transformations, the checks, and the support when a number downstream does not match.\nIt is a permanent seat in Centurion, in a retail investments technology team, reporting to the Head of Application Development. You will build and run data pipelines and the platform they sit on, so analytics, BI and the business get data they can trust. You will also set technical direction in the team. That means design calls, engineering standards, and how AI is used in the work without breaking governance.\nWhat you will do\nDeliver data engineering work inside an Agile team. Plan it, estimate it, break features into tasks, and hit the quality bar you agreed with the product owner.\nDesign and build ingestion and transformation pipelines across systems and domains. Batch and incremental. Error handling, monitoring, alerting, validation and reconciliation included.\nShape solutions that fit the target data platform. The environment is cloud and AWS-aligned. You will be expected to call the cost, security, performance and support impact of a design before it is built.\nCoach less experienced data engineers. Give analytics, BI and data science a clear view of structures, availability and how a pipeline actually behaves.\nReview code and configuration. Simplify what is already there. Use Git, automated testing, CI/CD and structured releases. Document enough that someone else can support it.\nUse AI in the engineering workflow, on approved tools only. You validate the output. You do not put client or proprietary data into a public model. You stay accountable for what goes to production.\nJoin incident response and root-cause work when a pipeline fails, and build privacy, access control and regulatory requirements in from the start.\nRequirements\nhat you need\nA bachelor’s degree in Computer Science, Information Systems, Engineering or a related field. A relevant certification helps.\n4-7+ years in data engineering, with production pipelines and platforms you can talk through.\nStrong AWS data architecture experience.\nAdvanced Python and SQL.\nData modelling, analytics-oriented schema design and warehousing.\nIngestion from relational databases, cloud storage, APIs and files.\nGit, CI/CD and automation. Agile or SAFe delivery.\nYou have used AI in engineering work and you know how to check it.\nPower BI or a similar BI tool is useful.\nYou can explain a constraint to a business stakeholder and a design choice to another engineer.","description_format":"text","description_chars":2544,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-31T07:12:17Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.596,"p_room":1,"age_days":0,"expected_fill_days":7,"reasons":["seen:0","agency","wave","velocity","win:early","comp:brand"],"computed_at":"2026-11-01T06:10:25Z"},"pay":null,"html_url":"https://alion.io/job/job-mail-senior-data-engineer-18","json_url":"https://alion.io/job/job-mail-senior-data-engineer-18.json","meta":{"generated_at":"2026-11-01T17:31:40Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":26809,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-02T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":701519},"rest":"https://alion.io/mcp/rest/get_company?id=701519"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fjob-mail-senior-data-engineer-18"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fjob-mail-senior-data-engineer-18"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fjob-mail-senior-data-engineer-18"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/job-mail-senior-data-engineer-18\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fjob-mail-senior-data-engineer-18"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3563549}},{"tool":"search_jobs","arguments":{"company":"jobmail.co.za","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3563549},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}