{"id":677276,"url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks","title":"Senior Data Engineer / Consultant - Databricks","company":{"id":679435,"name":"ICM Asia Pacific","domain":"icmasiapacific.co.nz","url":"https://alion.io/company/icmasiapacific","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-02T06:13:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["New Zealand"],"countries":["NZ"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":50000,"max_usd":132000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2679},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Git","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MuleSoft","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Apex","optional":true}],"status":"live","first_seen_at":"2026-04-07T00:00:00Z","employer_posted_date":"2026-04-07","last_verified_at":"2026-11-02T19:50:46Z","board_verified":true,"closed_at":null,"days_open":209,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":209},"description":"ABOUT ADAPTIV\nAdaptiv is a Kiwi success story specialising in Integration, Data, AI and Cloud Consulting. We help organisations unlock greater value from their data through modern integration and analytics solutions built on technologies including Databricks, Microsoft Azure, Microsoft Fabric, MuleSoft, Boomi and Solace.\nBased in our Grey Lynn/Ponsonby offices, we offer a collaborative, people-first culture where curiosity, initiative and continuous learning are valued. We combine strong technical capability with a practical, down-to-earth approach and are looking for people who share that mindset.\nWe are ideally seeking candidates based in Auckland. We will also consider people located in Christchurch, Wellington or elsewhere in New Zealand who are able to travel when required.\nABOUT THE ROLE\nWe are looking for experienced Senior Data Engineers / Consultants to join our growing Data Practice.\nThese are hands-on consulting roles focused on delivering modern Databricks and Azure-based data solutions across a variety of client environments. You will work closely with clients, architects and delivery teams to design, build, deploy and optimise scalable data platforms that deliver meaningful business outcomes.\nSuccess in this role requires strong engineering capability together with the confidence to engage directly with stakeholders, understand business requirements and translate them into practical, supportable data solutions.\nAs a senior member of the team, you will also contribute to solution design, mentor other engineers and help strengthen the frameworks, standards and reusable delivery practices supporting Adaptiv’s continued growth.\nWHAT YOU’LL BE DOING\nDesign, build and optimise production data pipelines across Lakehouse and data warehouse environments.\nDevelop high-quality data transformations using Python, PySpark and SQL for analytics, reporting and AI/ML workloads.\nDeliver solutions using Azure Databricks, Delta Lake, notebooks, workflows and Medallion Architecture.\nWork with Lakeflow Spark Declarative Pipelines, formerly Delta Live Tables, where appropriate.\nImplement governance and security practices using capabilities such as Unity Catalog.\nBuild and maintain automated deployment processes using Git, Databricks Asset Bundles and CI/CD pipelines.\nWork with orchestration technologies such as Databricks Workflows, Azure Data Factory or Apache Airflow.\nImplement automated testing, monitoring, data-quality and operational-support practices.\nLead technical discussions and translate business requirements into practical engineering outcomes.\nCollaborate with architects and delivery teams on solution design, estimation and delivery planning.\nCommunicate delivery progress, risks and technical decisions clearly to clients and internal stakeholders.\nMentor junior and intermediate engineers and support knowledge sharing across the Data Practice.\nContribute to the continuous improvement of engineering frameworks, templates and delivery standards.\nWHAT YOU’LL BRING\nSignificant commercial Data Engineering experience, ideally gained across complex enterprise environments.\nStrong recent hands-on experience delivering production solutions using Databricks.\nDemonstrated capability across Python, PySpark and SQL.\nExperience building Lakehouse, data warehouse or cloud-native data platforms.\nPractical experience with Delta Lake, notebooks, workflows and Medallion Architecture.\nExperience with modern Databricks capabilities such as Lakeflow/Delta Live Tables, Unity Catalog or Databricks Asset Bundles.\nStrong understanding of data modelling, scalable pipeline design and engineering-performance optimisation.\nExperience using Git, CI/CD and DevOps practices to deploy data solutions across environments.\nExperience implementing testing, monitoring, reconciliation or automated data-quality frameworks.\nStrong stakeholder engagement and communication capability.\nExperience gathering requirements and translating them into technical designs and delivery plans.\nExperience mentoring engineers or providing technical leadership while remaining hands-on.\nRelevant Databricks certification or a demonstrated commitment to ongoing professional development.\nExperience with Microsoft Fabric and the wider Azure Data Platform would be advantageous but is not essential where strong Databricks engineering capability is demonstrated.\nABOUT YOU\nYou are a strong communicator who enjoys working directly with clients and stakeholders.\nYou are self-motivated, organised and focused on successful delivery.\nYou are comfortable balancing multiple priorities and working through ambiguity.\nYou are curious, adaptable and committed to continuous learning.\nYou have a strong problem-solving mindset and take ownership of delivery outcomes.\nYou are professional, collaborative and enjoy contributing to a high-performing team.\nWHY JOIN ADAPTIV?\nJoin a high-performing, collaborative and supportive team.\nDeliver solutions using modern technologies including Databricks, Azure and Microsoft Fabric.\nWork across varied client environments and meaningful data-transformation programmes.\nAccess genuine opportunities for career growth and technical development.\nContribute to the development of Adaptiv’s growing Data Practice.\nWork from modern offices across Auckland, Christchurch, Wellington, Melbourne and Brisbane.\nMake a visible impact across client projects and the wider business.\nApplicants must already hold the appropriate right to work in New Zealand.\nIf you are looking to combine hands-on Databricks engineering with consulting, stakeholder engagement and technical leadership, we would love to hear from you.","description_format":"text","description_chars":5655,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Professional development"],"hiring_locations":[{"name":"New Zealand","iso":"NZ","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Mobile App Development Services","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-09-10T23:01:32Z"}],"visa":[],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":1,"p_active":0.21,"p_room":0.28,"age_days":209,"expected_fill_days":28,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-11-02T06:13:15Z"},"pay":null,"html_url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks","json_url":"https://alion.io/job/icmasiapacific-senior-data-engineer-consultant-databricks.json","meta":{"generated_at":"2026-11-02T22:40:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31873,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-03T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":679435},"rest":"https://alion.io/mcp/rest/get_company?id=679435"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/icmasiapacific-senior-data-engineer-consultant-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ficmasiapacific-senior-data-engineer-consultant-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":677276}},{"tool":"search_jobs","arguments":{"company":"icmasiapacific.co.nz","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":677276},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}