{"id":4642977,"url":"https://alion.io/job/fbca-lead-data-engineer","title":"Lead Data Engineer","company":{"id":2382864,"name":"FBCA","domain":"fbca.org.uk","url":"https://alion.io/company/fbca","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Romford, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":56058,"max":60393,"currency":"GBP","period":"year","gross":null,"usd_annual":79045},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ASP.NET Core","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"C#","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GDPR","optional":false},{"name":"Git","optional":false},{"name":"Master Data Management","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MS SQL","optional":false},{"name":"Power Apps","optional":false},{"name":"Power Automate","optional":false},{"name":"Power BI","optional":false},{"name":"PowerShell","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"SSIS","optional":false}],"status":"live","first_seen_at":"2026-11-19T16:18:43Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-20T03:55:27Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Lead Data Engineer\nSalary: £56,058 -£60,393 per annum (Grade 9)\nDirectorate: IT, Digital and Customer Services\nService: Digital\nReports to: Head of User-Centred Design & Digital Experience\nJob Description Help shape Havering's modern, connected and secure data estate\nThe London Borough of Havering is modernising how we manage, connect and use data across our services, with Microsoft Fabric at the heart of our future data and analytics architecture.\nWe're looking for an experienced, hands-on Lead Data Engineer to help develop and mature our Microsoft data environment, drive the phased migration and consolidation of legacy data platforms, and embed modern engineering and governance practices.\nOur existing corporate data warehouse brings together information from more than 30 council and supplier systems, supporting essential services including housing, social care, education, council tax, benefits, electoral registration and parking. This data underpins day-to-day operations, statutory reporting, fraud prevention and emergency response.\nOur ambition is to create a more integrated, scalable and well-governed data estate, reducing complexity, improving data quality and accessibility, and enabling better use of information across the Council.\nThis is an opportunity to contribute to meaningful data modernisation, combining hands-on engineering with the chance to influence how Havering's data capabilities develop over the coming years.\nAbout the role\nWorking within our Digital function, you'll take a leading, hands-on role in developing and modernising Havering's data estate, with Microsoft Fabric as our strategic data and analytics platform.\nYou'll work closely with data engineers, analysts, architects, software developers, service teams and external partners to deliver reliable solutions, improve engineering practices and support the transition from legacy technologies.\nYou'll take ownership of technical deliverables, contribute to solution design and engineering decisions, and help ensure our data services remain reliable, secure and maintainable as the environment evolves.\nYour key areas of focus will include:\nMicrosoft Fabric and data engineering: Developing, optimising and maintaining our Microsoft Fabric environment, including OneLake, Data Factory pipelines, lakehouses, warehouses, Spark notebooks, Delta tables and Power BI semantic models.\nLegacy migration and modernisation: Assessing and prioritising existing SQL Server data warehouses, SSIS packages, data marts and integrations; designing appropriate migration and modernisation approaches; and delivering phased improvements with robust testing, data validation and service continuity.\nData estate structure and engineering standards: Helping develop consistent approaches to workspace organisation, development, test and production environments, access management, source control, automated deployment, monitoring and operational management.\nData warehouse and integration: Developing, maintaining and improving SQL Server data warehouses and ETL/ELT processes, integrating data from cloud and on-premises databases, Dynamics 365, Dataverse, APIs, SFTP and other business systems.\nSQL development and optimisation: Writing and tuning complex T-SQL, stored procedures and views, improving performance and investigating data issues through root-cause analysis.\nMaster data and existing applications: Supporting person-matching services, golden-record management, UPRN-based address matching and the Local Land and Property Gazetteer, alongside existing ASP.NET/C# applications and opportunities for modernisation.\nData governance and security: Embedding data quality, ownership, metadata management, lineage and appropriate access controls into engineering solutions. Working with Information Governance and Data Protection colleagues to protect sensitive information, support DPIAs and meet UK GDPR requirements, while developing the use of Microsoft Fabric and Purview governance capabilities.\nPlatform performance and reliability: Monitoring and optimising data pipelines, workloads and platform performance, supporting capacity and cost efficiency, troubleshooting production issues and implementing reliable operational processes.\nDevOps and automation: Improving engineering practices through Git, Azure DevOps, CI/CD, automated testing and Microsoft Fabric deployment pipelines.\nTechnical leadership and collaboration: Taking ownership of engineering deliverables, contributing to technical decisions, mentoring colleagues, reviewing technical work and promoting consistent, maintainable engineering practices across the data estate.\nFuture digital capabilities: Establishing trusted, reusable data foundations for analytics, Power BI, Power Platform, joined-up digital services, automation and responsible AI adoption.\nTechnology you'll work with\nOur strategic direction is centred on the Microsoft ecosystem, with Microsoft Fabric forming the foundation of our future data and analytics platform.\nFuture data environment\nMicrosoft Fabric, including OneLake, Data Factory, Lakehouse, Warehouse, PySpark, Spark SQL and Delta tables\nMicrosoft Azure data and integration services\nPower BI and semantic models\nMicrosoft Purview\nAzure DevOps, Git and CI/CD\nDynamics 365, Dataverse and Power Platform\nExisting data environment\nMicrosoft SQL Server, T-SQL and SSIS\nSQL Server Agent, stored procedures and data marts\nASP.NET/C# web applications\nMaster data management, person matching and address gazetteer services\nAPIs, SFTP, files and integrations across on-premises and cloud systems\nAbout you\nWe're looking for a skilled and proactive data engineer who enjoys solving complex problems, takes ownership of technical delivery and is motivated by the opportunity to modernise a significant data environment.\nYou'll bring:\nStrong experience developing and supporting SQL Server data warehouses, data marts and ETL/ELT processes in production environments.\nAdvanced T-SQL skills, including query optimisation, stored procedures and troubleshooting.\nExperience building and maintaining reliable data pipelines, including SSIS or comparable integration technologies.\nExperience with Microsoft Fabric, Azure Data Factory, Databricks or another modern cloud data engineering platform.\nExperience modernising or migrating legacy data solutions to cloud-based environments.\nGood knowledge of data modelling, integration patterns, data quality and performance optimisation.\nExperience integrating data from databases, business applications, APIs and file-based sources.\nFamiliarity with Git, Azure DevOps or equivalent source control and deployment practices.\nAn understanding of data governance, information security and UK GDPR, including handling sensitive information.\nStrong problem-solving and communication skills, with the ability to work collaboratively across technical and service teams.\nExperience in the following areas would be advantageous:\nHands-on Microsoft Fabric experience, including lakehouses, warehouses, PySpark, Spark SQL and Delta Lake.\nMicrosoft Purview and data governance tooling.\nDynamics 365, Dataverse, Power Apps or Power Automate.\nASP.NET/C# applications connected to SQL Server.\nMaster data management, person matching, UPRN and address data management.\nPython, PowerShell or Azure Logic Apps.\nLocal government or other public sector data environments.\nRelevant Microsoft certifications, such as DP-600 or DP-700.\nWe don't expect you to be an expert in every technology listed. What matters most is strong data engineering expertise, sound technical judgement, a commitment to delivering reliable solutions and a willingness to embrace new technologies as our data estate evolves.\nWhy join us?\nYou'll have the opportunity to help shape Havering's future data estate, working with modern Microsoft technologies while contributing to the migration and modernisation of existing systems.\nYour work will support essential public services, improve how information is shared and used, and help establish the foundations for better analytics, digital services and responsible AI adoption.\nYou'll be part of a collaborative Digital function, working alongside engineers, architects, analysts and service teams, with opportunities to develop your skills, influence technical decisions and deliver meaningful improvements.\nIf you enjoy solving complex data challenges, working with modern technologies and making a practical difference through better use of data, we'd welcome your application.\nPlease viewJob Profilehere\nFor an informal discussion about the post, please contact \nThe closing date for applications is 24 December 2026. We reserve the right to close the vacancy early if there is significant interest.\nSuccessful applicants will be contacted with details of the next stage of the recruitment process.\nAdditional Information\nWe want everyone to choose Havering. When you apply for a job with us, your application is considered on its merits regardless of your age, disability, ethnicity, faith, gender identity or sexual orientation. Our residents and service users come from all walks of life, and so do our employees. Find out what it means to Choose Havering.\nThe London Borough of Havering has important responsibilities for safeguarding and promoting the welfare of children, young people and vulnerable adults. If you are appointed to a job that involves working with these groups, you may be subject to a Disclosure and Barring Service (DBS) check.\nPlease attach your supporting statement, explaining in no more than two A4 sides why and how you meet the criteria for this role.\nWe practise anonymised recruitment. Please ensure that you remove all personal information from any documents that you upload.","description_format":"text","description_chars":9776,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Construction","Standards & Industry Bodies"],"lifecycle":[{"event":"open","at":"2026-11-19T23:31:52Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":17,"reasons":["conf:1","win:early"],"computed_at":"2026-11-20T05:28:53Z"},"pay":{"stated_usd_annual":79045,"is_top_pay":false},"html_url":"https://alion.io/job/fbca-lead-data-engineer","json_url":"https://alion.io/job/fbca-lead-data-engineer.json","meta":{"generated_at":"2026-11-20T05:28:53Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2635,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2382864},"rest":"https://alion.io/mcp/rest/get_company?id=2382864"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffbca-lead-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffbca-lead-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffbca-lead-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fbca-lead-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffbca-lead-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4642977}},{"tool":"search_jobs","arguments":{"company":"fbca.org.uk","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4642977},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}