{"id":2166180,"url":"https://alion.io/job/next-lead-data-engineer","title":"Lead Data Engineer","company":{"id":1758752,"name":"Next","domain":"next.co.uk","url":"https://alion.io/company/next-co-uk","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":99,"open_postings":4,"ghost_share":0,"stale_share":0.25,"repost_share":0,"time_to_fill_p50_days":7,"computed_at":"2026-10-10T05:45:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Leicester, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":90000,"max_usd":160000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":28},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Cosmos DB","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Machine Learning","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"GCP","optional":true},{"name":"RAG","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-10-09T08:24:24Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-12T00:24:38Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"We are looking for a Lead Data Engineer to join our eCommerce Data team. Based from NEXT Head Office in Enderby, Leicestershire!\nThe Role:\nAs a Lead Data Engineer, you will play a pivotal role in designing, building and evolving our cloud based data platform on Azure. You will be responsible for developing scalable, reliable and high performance data solutions that power analytics, reporting and emerging AI capabilities across the business.\nWorking primarily with Azure Databricks, PySpark, SQL and Azure Data Factory, you will lead the development of robust data pipelines, champion engineering best practices and help shape the technical direction of our data platform. You will also drive the design of a modern, AI ready data model that enables faster adoption of machine learning, generative AI and advanced analytics.\nThis is a hands-on technical leadership role where you'll mentor engineers, collaborate closely with business stakeholders and balance technical excellence with commercial priorities to ensure the team delivers maximum business value.\nWhat You’ll Take On:\nDesign, develop, and maintain scalable data pipelines and ETL/ELT processes using Azure services such as Azure Data Factory, Azure Databricks, and Azure Data Lake Storage.\nDesign and evolve a modern enterprise data model that provides trusted, reusable data assets and accelerates AI, machine learning, and advanced analytics initiatives.\nEnsure data quality, integrity, security, and governance across the data platform by implementing engineering best practices and robust monitoring.\nCollaborate with data scientists, analysts, product teams, and business stakeholders to understand requirements and deliver scalable data solutions.\nOptimise data platforms and pipelines for performance, scalability, reliability, and cost efficiency.\nLead the implementation of streaming data solutions and Delta Live Tables using PySpark and Databricks.\nBuild and maintain CI/CD pipelines for data engineering solutions using Azure DevOps, Git, and infrastructure-as-code where appropriate.\nIntegrate with third-party systems and APIs to support secure and reliable data ingestion.\nMentor and support junior engineers, promoting high engineering standards, knowledge sharing, and continuous improvement.\nTroubleshoot and resolve complex data engineering challenges while ensuring high availability of critical data services.\nDevelop a strong understanding of business priorities and commercial objectives, helping to prioritise engineering work that delivers the greatest value and business impact.\nWhat You’ll Bring:\nStrong Python, PySpark and SQL skills with extensive experience designing, developing and optimising large scale data pipelines.\nHands-on experience with Azure data technologies, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Delta Lake.\nExperience working with relational and NoSQL databases such as Cosmos DB.\nExperience building streaming data pipelines and Delta Live Tables using Databricks.\nStrong understanding of modern data modelling techniques, including designing data models that support analytics and AI workloads.\nExperience implementing CI/CD pipelines using Azure DevOps, Git, and related tooling.\nExperience integrating with third party APIs and external data sources.\nStrong understanding of data governance, data quality, security and operational best practices.\nExcellent problem solving, communication and stakeholder management skills.\nStrong commercial awareness, with the ability to balance technical priorities against business value and make pragmatic engineering decisions.\nDesirable Skills:\nKnowledge of machine learning concepts, MLOps and deploying data products for AI use cases.\nExperience with modern AI and Generative AI platforms, including preparing data for Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) solutions.\nExperience with other cloud platforms such as AWS or GCP.\nExperience with enterprise data governance frameworks and tooling.","description_format":"text","description_chars":4020,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Consumer Goods","Home Decor","Children's Clothing"],"lifecycle":[{"event":"open","at":"2026-10-09T10:05:32Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":7,"reasons":["conf:0","velocity","win:early","comp:brand"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/next-lead-data-engineer","json_url":"https://alion.io/job/next-lead-data-engineer.json","meta":{"generated_at":"2026-10-12T02:22:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3419,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1758752},"rest":"https://alion.io/mcp/rest/get_company?id=1758752"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnext-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnext-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnext-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/next-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnext-lead-data-engineer"}]}