{"id":677277,"url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks-2","title":"Senior Data Engineer / Consultant - Databricks","company":{"id":679435,"name":"ICM Asia Pacific","domain":"icmasiapacific.co.nz","url":"https://alion.io/company/icmasiapacific","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Melbourne, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":74000,"max_usd":193000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2679},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Apex","optional":true},{"name":"Microsoft Fabric","optional":true},{"name":"MuleSoft","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-05-01T00:00:00Z","employer_posted_date":"2026-05-01","last_verified_at":"2026-10-29T23:49:19Z","board_verified":true,"closed_at":null,"days_open":182,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":181},"description":"About Us\nAdaptiv is a Kiwi success story with a growing presence across Australia and New Zealand. We specialise in integration, data and analytics, AI consulting and cloud solutions, helping organisations modernise their technology environments and unlock greater value from their data.\nOur teams work with leading technologies including Databricks, Microsoft Azure, Microsoft Fabric, MuleSoft, Boomi and Solace to solve complex business and technology challenges.\nWhat sets Adaptiv apart is our combination of deep technical capability and genuine consulting expertise. We work closely with our clients to understand their challenges, design pragmatic solutions and deliver technology that creates meaningful business outcomes.\nAs our Australian Data Practice continues to grow, we're looking for an experienced Senior Data Engineer / Data Consultantto join our team in Melbourne or Brisbane.\nAbout the Role\nThis is a senior, hands-on consulting role for someone who combines strong Data Engineering capability with the confidence to work directly with clients.\nYou'll help design, build and deliver modern data platforms and engineering solutions, with a particular focus on Databricks and cloud-based data architectures.\nYou'll work across client engagements, collaborating with architects, consultants and engineering teams to translate business requirements into scalable, production-ready data solutions.\nThis isn't a role where you'll simply provide technical oversight. You'll remain close to the technology - designing solutions, building pipelines, writing code, solving complex engineering problems and helping ensure the quality of what we deliver.\nYou'll also play an important role in supporting and mentoring other engineers as our Data Practice continues to grow across Australia.\nWhat You'll Be Doing\nDesigning, building and optimising modern data pipelines across data lakes, lakehouses and data warehouses.\nDelivering production-grade solutions using Databricksand associated cloud data technologies.\nDeveloping data transformations and engineering solutions using Python, PySpark and SQL.\nWorking with Databricks notebooks, workflows and Lakeflow Declarative Pipelines (formerly Delta Live Tables).\nApplying modern data architecture patterns including Lakehouse and Medallion architectures.\nDesigning and implementing robust data models for analytics, reporting and downstream data consumption.\nApplying software engineering and DevOps practices including Git, CI/CD, automated deployment and environment management.\nImplementing testing, data validation, monitoring and performance optimisation to ensure reliable production data solutions.\nWorking directly with clients to understand requirements and translate business needs into pragmatic technical solutions.\nLeading technical discussions and communicating engineering concepts to both technical and non-technical stakeholders.\nCollaborating with architects and other consultants on solution design, estimation, scoping and delivery planning.\nIdentifying delivery risks, communicating progress and helping resolve technical blockers.\nConducting peer reviews and supporting high standards across code, documentation and engineering practices.\nMentoring junior and intermediate engineers and contributing to knowledge sharing across the Data Practice.\nHelping improve Adaptiv's reusable frameworks, delivery patterns, templates and engineering standards.\nStaying current with developments across Databricks, cloud data platforms, AI/ML and the broader modern data ecosystem.\nWhat You'll Bring\nWe're looking for someone with a strong Data Engineering foundation who is equally comfortable building solutions and engaging with clients.\nIdeally, you'll bring:\n6+ years' professional experienceacross Data Engineering, Data Platforms or a closely related discipline.\nStrong hands-on experience delivering production Data Engineering solutions using Databricks.\nPractical experience with Databricks notebooks, workflows, Lakehouse architectures and modern data pipeline development.\nStrong Python, PySpark and SQLcapability.\nExperience designing and developing ETL/ELT pipelines and complex data transformations.\nA good understanding of modern data architecture patterns, including Medallion architectureand scalable Lakehouse design.\nStrong data modelling knowledge, including dimensional, Star and Snowflake modelling approaches.\nExperience with cloud data platforms, ideally within Microsoft Azureor another major cloud ecosystem.\nExperience applying DevOps and software engineering practices including version control, CI/CD and automated deployment.\nExperience implementing testing, data quality and validation practices within production data environments.\nFamiliarity with analytics and data consumption technologies such as Power BIor similar platforms.\nStrong communication skills and the confidence to work directly with clients and senior stakeholders.\nExperience working within consulting, professional services or client-facing delivery environments, or demonstrable experience operating in a similar capacity.\nThe ability to work autonomously while collaborating effectively across multidisciplinary delivery teams.\nExposure to Microsoft Fabricand the wider Microsoft Data ecosystem would be advantageous but isn't essential.\nRelevant Databricks, Azure or other cloud certifications are highly regarded, along with a demonstrated commitment to ongoing professional development.\nThe Person We're Looking For\nTechnical capability matters, but we're looking for more than someone who can build a pipeline.\nYou'll enjoy working with customers, asking the right questions and understanding the problem behind the technical requirement.\nYou'll be comfortable taking ownership of your work, making pragmatic engineering decisions and explaining those decisions clearly to others.\nYou'll enjoy helping other engineers develop and won't be afraid to challenge an approach when you believe there's a better way.\nMost importantly, you'll want to remain hands-onwhile continuing to grow as a consultant and senior technical professional.\nWhy Adaptiv?\nYou'll join a growing Data Practice where you'll have the opportunity to influence how we deliver, not simply inherit established processes.\nYou'll work with modern technologies, interesting clients and experienced people across Data, Integration, Cloud and AI.\nWe offer an environment where technical curiosity is encouraged, good ideas are heard and people are trusted to take ownership.\nIf you're an experienced Data Engineer looking for a role that combines hands-on Databricks engineering, client engagement and genuine consulting responsibility, we'd love to hear from you.","description_format":"text","description_chars":6701,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile App Development Services","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-09-10T23:01:32Z"}],"visa":[],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":1,"p_active":0.206,"p_room":0.28,"age_days":181,"expected_fill_days":28,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks-2","json_url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks-2.json","meta":{"generated_at":"2026-10-30T01:44:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2303,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":679435},"rest":"https://alion.io/mcp/rest/get_company?id=679435"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/icmasiapacific-senior-data-engineer-consultant-databricks-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":677277}},{"tool":"search_jobs","arguments":{"company":"icmasiapacific.co.nz","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":677277},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}