{"id":3512171,"url":"https://alion.io/job/endava-lead-data-engineer-2","title":"Lead Data Engineer","company":{"id":6702,"name":"Endava","domain":"endava.com","url":"https://alion.io/company/endava","size_band":"51-200","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":28,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":26,"computed_at":"2026-11-04T06:34:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sydney, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":88000,"max_usd":202000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":771},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-30T05:09:21Z","employer_posted_date":"2026-10-30","last_verified_at":"2026-11-04T15:56:24Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"Technology is our how, and people are our why. For 20-plus years we have paired world-class engineering with deep industry insight, helping global brands create intelligent digital experiences that drive meaningful change. Join us as we expand our Australian Data & AI capability and help clients unlock the full value of their data assets.\n We’re looking for a Lead Data Engineer to help our clients design, build and operate reliable data platforms that turn complex data into useful business insights.\nYou’ll work across the data lifecycle, from architecture and source integration through to data pipelines, semantic models, visualisation and reporting. You’ll bring strong engineering skills in Python and SQL, alongside hands-on experience with at least one of Databricks, Snowflake or Microsoft Fabric.\nWorking closely with clients, analysts, data scientists and fellow engineers, you’ll translate business requirements into secure, maintainable and scalable data solutions. You’ll also provide technical guidance, contribute to design decisions and help the team strengthen its engineering practices.\nWhat you’ll do\nDesign, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.\nDevelop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.\nContribute to data architecture and solution design, including data storage, integration and modelling.\nDevelop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.\nImplement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.\nTroubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.\nApply data quality controls, automated testing and validation throughout the data lifecycle.\nImplement role-based access control and follow security best practices for data platforms and integrations.\nApply DevOps practices to data engineering, including version control, repository management, CI/CD and automated deployment.\nBuild data visualisations and reports that make information clear and useful to business users.\nDocument solutions, review code and share knowledge to support maintainable delivery and continuous improvement.\n What you’ll bring\nHands-on experience delivering production data solutions using one or more of Databricks, Snowflake or Microsoft Fabric.\nStrong programming skills in Python and SQL.\nExperience designing, developing and operating data pipelines, including ETL/ELT processes, orchestration and monitoring.\nA sound understanding of data architecture and modelling techniques, including analytical and dimensional modelling.\nAn understanding of ontologies and semantic modelling, and how they connect data structures to business concepts.\nPractical experience optimising data processing and troubleshooting pipeline, query and platform performance.\nExperience integrating data through APIs, including authentication, error handling and reliable data exchange.\nExperience applying role-based access control (RBAC) and data security best practices.\nExperience using Git, maintaining repositories, writing automated tests and building CI/CD workflows for data solutions.\nExperience developing data visualisations and reports.\nThe ability to explain technical choices clearly, work collaboratively with business and technical stakeholders, and guide other engineers.\nUseful additional experience\nPostgreSQL, SQL Server, Google BigQuery or Amazon Redshift.\nR or other programming languages.\nRelevant cloud services across Microsoft Azure, AWS or Google Cloud.\nRelevant certifications in Databricks, Snowflake or Microsoft Fabric.\n Flexible, hybrid working - 20 “work from anywhere” days per year on top of our hybrid policy.\nGlobal career pathways and non-linear progression; move between domains, disciplines or geographies.\nContinuous learning via certifications, internal academies, tech communities and funded conferences.\nWell-being & lifestyle allowance, loyalty leave, inclusive parental leave and employee assistance programmes.\nA vibrant, inclusive culture where diverse perspectives power innovation.\nReady to drive AI-powered transformation?\nApply today with your CV and a short cover note outlining a data-led solution you are proud to have shaped. We look forward to exploring how your expertise can help our clients turn bold ideas into real-world impact.\nEndava is an equal-opportunity employer. We value the differences that make us stronger and commit to transparent, merit-based hiring.\nAdditional Local Benefits\nMonthly Lifestyle Allowance: Contribution towards health and wellbeing activities like gym memberships. \nNovated Leasing: Pre-tax car leasing benefit for new and used cars. \nLoyalty Leave: Receive an additional day of leave on your 3rd, 4th, and 5th work anniversaries, accumulating up to a maximum of 3 extra days of leave per year.\nInclusive Parental Leave Policy: 12 weeks of primary carer’s leave and 4 weeks of secondary carer’s leave. \n Work From Anywhere: In addition to our hybrid working policy, we also offer 20 days of working from anywhere per year. Ideal for an extended trip to get away from the city or visiting loved ones.\nAt Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives-because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.","description_format":"text","description_chars":5851,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Gym membership","Hybrid work","Parental leave"],"hiring_locations":[{"name":"Australia","iso":"AU","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-30T08:25:36Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":5,"expected_fill_days":26,"reasons":["conf:0","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-04T06:34:25Z"},"pay":null,"html_url":"https://alion.io/job/endava-lead-data-engineer-2","json_url":"https://alion.io/job/endava-lead-data-engineer-2.json","meta":{"generated_at":"2026-11-04T16:42:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25507,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6702},"rest":"https://alion.io/mcp/rest/get_company?id=6702"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fendava-lead-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fendava-lead-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fendava-lead-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/endava-lead-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fendava-lead-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3512171}},{"tool":"search_jobs","arguments":{"company":"endava.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3512171},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}