{"id":4653471,"url":"https://alion.io/job/wrkr-senior-data-engineer-data-ai","title":"Senior Data Engineer - Data & AI","company":{"id":4280180,"name":"WRKR","domain":"wrkr.mx","url":"https://alion.io/company/wrkr-mx","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Adelaide, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Git","optional":false},{"name":"GitLab","optional":false},{"name":"IAM","optional":false},{"name":"Machine Learning","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Amazon Aurora","optional":true},{"name":"GitLab CI","optional":true},{"name":"MLFlow","optional":true}],"status":"live","first_seen_at":"2026-11-20T02:43:15Z","employer_posted_date":null,"last_verified_at":"2026-11-20T02:43:15Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"About Wrkr\n\nWrkr Ltd (ASX: WRK) is a scale-up whose award-winning platform helps close to 3 million Australian workers resolve their compliance moments. We work in partnership with many of Australia’s leading payrolls, superannuation funds and accountants. Our purpose is to make “Compliance, Simple.” We’re entering our next phase of growth, and we’re looking for someone who wants a front-row seat in an inclusive, supportive and flexible team. This role is employed by Comply Path Pty Ltd, a wholly owned subsidiary of Wrkr Ltd.\n\nThe role\n\nYou’ll be the senior, hands-on engineer in our Adelaide-based Data & AI team, building and running the Wrkr Lakehouse on Databricks. The Lakehouse is how we share reporting and analytics data with our superannuation fund and administrator customers. It increasingly powers internal analytics, self-serve reporting and AI across the business.\n\nYou’ll design and own reliable, well-governed pipelines and data products. You’ll coach the engineers around you and set the standards the team works to. You’ll also work with the Head of Data and AI to shape the technical direction and roadmap for the Lakehouse and our AI foundations.\n\nOur stack: Databricks on AWS, Delta Lake, Unity Catalog and a medallion architecture; Python, PySpark and SQL; CDC from Aurora PostgreSQL, moving towards event-sourced ingestion with data contracts; Delta Sharing, Databricks SQL and Amazon QuickSight; Terraform and GitLab CI/CD. We build it, we run it. Australians’ retirement savings depend on this data, so we invest in quality, security and long-term solutions over quick fixes.\n\nWhat you’ll do\n\n- Design, build and run scalable, secure pipelines in Python, PySpark and SQL across bronze, silver and gold layers, including dimensional models for reporting.\n\n- Ingest data through CDC and help lead the shift to event-sourced ingestion with a data contract per service.\n\n- Own data quality and freshness through tests, expectations, reconciliations and monitoring, so customers can trust the data.\n\n- Implement governance and access control in Unity Catalog, including lineage and safe handling of PII and sensitive member data.\n\n- Deliver data products to customers via Delta Sharing and to internal users via Databricks SQL, QuickSight and self-serve datasets.\n\n- Manage workspaces, jobs and AWS resources with Terraform and GitLab pipelines.\n\n- Optimise the performance and cost of Spark workloads, SQL warehouses and serverless compute.\n\n- Prepare analysis-ready datasets for AI and machine learning use cases.\n\n- Mentor one to two engineers through pairing, code review, 1:1s and development plans.\n\n- Set and champion engineering standards: code review, testing, documentation and ADRs.\n\n- Contribute to the Data & AI strategy and roadmap, including architecture, build-vs-buy decisions and prioritisation.\n\nWhat you’ll bring\n\n5+ years as a Data Engineer or similar, including at least 2 at a senior level.\n\nStrong Python, PySpark and SQL for production pipelines.\n\nHands-on Databricks experience: Delta Lake, Unity Catalog, Lakeflow Jobs and Databricks SQL.\n\nSolid data modelling skills, including Kimball dimensional modelling and medallion architecture.\n\nExperience with CDC, incremental processing and streaming or event-driven sources.\n\nA track record of building data quality, testing and observability into pipelines.\n\nAWS experience (S3, IAM, Glue, Athena), and strong SQL performance tuning, ideally on PostgreSQL.\n\nIaC and CI/CD for data platforms, and Git, including rebase-based workflows.\n\nExperience mentoring engineers and contributing to data strategy and architecture decisions.\n\nClear communication, including explaining data concepts to non-technical people.\n\nNice to have\n\nDatabricks or AWS certifications.\n\nLakeflow Declarative Pipelines (DLT), Auto Loader or Databricks Asset Bundles.\n\nExperience sharing data with external customers, ideally via Delta Sharing.\n\nExperience with QuickSight or other BI tools.\n\nExperience with regulated or sensitive data, such as superannuation, payroll or financial services.\n\nMLflow, MLOps, or hands-on experience training and evaluating ML models.\n\nWhat’s on offer\n\n$160,000 – $180,000 + superannuation, full time.\n\nFlexible working culture.\n\nLearning and development opportunities, plus the policies and benefits of a progressive tech business.\n\nReal influence over the architecture and direction of a growing data platform.\n\nBefore you apply\n\nResearch shows that men tend to apply when they meet around 60% of the criteria, while women and people from marginalised backgrounds often apply only when they tick every box. If you think you could do this role well but don’t meet every point, please apply anyway.\n\nTo be considered, you must be an Australian citizen or permanent resident. Please include a cover letter telling us:\n\nWhy are you the right candidate for this role?\n\nDo you have the necessary qualifications?\n\nThe position may involve work outside of ordinary hours. This could include weekends, nights or public holidays. Are you available to work flexible hours\n\nDo you have or are you willing to obtain a current Police Check?\n\nDo you have experience in a similar role?","description_format":"text","description_chars":5175,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence"],"lifecycle":[{"event":"open","at":"2026-11-20T02:43:15Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["seen:0","win:early"],"computed_at":"2026-11-20T05:46:30Z"},"pay":null,"html_url":"https://alion.io/job/wrkr-senior-data-engineer-data-ai","json_url":"https://alion.io/job/wrkr-senior-data-engineer-data-ai.json","meta":{"generated_at":"2026-11-20T09:23:10Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9018,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4280180},"rest":"https://alion.io/mcp/rest/get_company?id=4280180"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fwrkr-senior-data-engineer-data-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fwrkr-senior-data-engineer-data-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fwrkr-senior-data-engineer-data-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/wrkr-senior-data-engineer-data-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fwrkr-senior-data-engineer-data-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4653471}},{"tool":"search_jobs","arguments":{"company":"wrkr.mx","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4653471},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}