{"id":3993494,"url":"https://alion.io/job/shift-senior-data-engineer","title":"Senior Data Engineer","company":{"id":174878,"name":"Shift","domain":"shift.com.au","url":"https://alion.io/company/shift-3","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sydney, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GitHub","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-09T21:57:26Z","employer_posted_date":"2026-11-09","last_verified_at":"2026-11-10T00:23:37Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Who is Shift?\n\n Shift provides business finance to small, established and corporate sized businesses in Australia, including Business Overdraft, Equipment Line, Asset Finance, Term Loan and Trade Account. Founded in 2014, Shift has funded more than 30,000 Australian businesses.\nAt Shift, our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 300 people who are always looking to deliver better outcomes for Australian businesses.\nAbout the role:\nWant to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two junior engineers to develop and plenty of room to shape how data works at Shift.\nWhat you’ll do:\nOwn the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog\n\nDesign and lead the build of robust, scalable ELT pipelines on Azure Databricks\n\nLead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering\n\nBuild and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data\n\nLift data quality, freshness and alerting so issues are caught before the business notices them\n\nKeep the platform cost-efficient through cluster optimisation, job orchestration and smart use of compute\n\nMentor and develop our junior data engineers through code review, pairing and clear standards\n\nPartner with analysts, data scientists, product managers and Engineering to turn business needs into data products people trust\n\nWhat you’ll bring:\n5+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog)\n\nStrong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles)\n\nA track record of lifting standards on an existing platform, not just building something new on a clean slate\n\nSolid dimensional modelling experience (star schemas, conformed dimensions, medallion architecture)\n\nExperience mentoring engineers and leading technical decisions through design and code review\n\nThe ability to explain technical direction clearly to non-technical stakeholders, and an instinct to work across teams rather than in a silo\n\nExperience leading the data side of a core system migration is a strong plus\n\nKey benefits:\nHybrid working: we’re headquartered in North Sydney with state-based workplaces and offer a hybrid work policy. Our offices have spaces for collaboration, socialising and focused work.\n\nParental leave: up to 26 weeks paid.\n\nStrategy Week: twice a year the whole team comes together to hear the business strategy and product and technology roadmap first-hand, with fortnightly all-company business updates in between.\n\nFlat structure: everyone can learn from each other and senior leaders across the business.\n\nWellbeing: benefits supporting your physical, psychological and financial wellbeing, from a day off on your birthday to end of trip facilities.\n\nAdditional information:\nIf you don’t meet all the qualifications or skills but think you’d be a great fit, please apply anyway.\nLearn more about working at Shift at shift.com.au/careers.","description_format":"text","description_chars":3531,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Hybrid work","Parental leave"],"hiring_locations":[{"name":"Australia","iso":"AU","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Business & SME Lending","Factoring & Trade Finance"],"lifecycle":[{"event":"open","at":"2026-11-10T00:23:37Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":38,"reasons":["conf:5","win:early"],"computed_at":"2026-11-10T05:29:44Z"},"pay":null,"html_url":"https://alion.io/job/shift-senior-data-engineer","json_url":"https://alion.io/job/shift-senior-data-engineer.json","meta":{"generated_at":"2026-11-10T05:29:44Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12776,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":174878},"rest":"https://alion.io/mcp/rest/get_company?id=174878"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fshift-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fshift-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fshift-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/shift-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fshift-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3993494}},{"tool":"search_jobs","arguments":{"company":"shift.com.au","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3993494},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}