{"id":2924050,"url":"https://alion.io/job/scrumconnect-lead-data-engineer-sc-cleared","title":"Lead Data Engineer (SC Cleared)","company":{"id":3861039,"name":"Scrumconnect Consulting","domain":"scrumconnect.com","url":"https://alion.io/company/scrumconnect","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":{"grade":"B","score":80,"open_postings":24,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":9,"computed_at":"2026-10-24T06:02:35Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Newcastle, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":95000,"max_usd":166000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":34},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Java","optional":false},{"name":"Platform Engineering","optional":false},{"name":"PostgreSQL","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-09-23T00:00:00Z","employer_posted_date":"2026-09-23","last_verified_at":"2026-10-24T21:05:01Z","board_verified":true,"closed_at":null,"days_open":31,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":31},"description":"AboutScrumconnect Consulting\nScrumconnect Consulting is a multi-award-winning UK public sector digital consultancy, positively influencing the lives of over forty million UK citizens. We bring deep expertise in agile delivery, digital transformation, and platform engineering across central government. With a team of over one hundred and twenty-five professionals - more than forty percent of whom are women - we are committed to building inclusive, diverse teams that reflect the communities we serve.\nRole Overview\nWe are looking forLead Data Engineer to join a dedicated Data Migration Squad supporting the migration of CRS data and reporting capabilities to a new platform.\nThe role requires strong specialist expertise in data migration, data modelling, ETL, database design, and Azure PostgreSQL. You will take technical ownership of designing and delivering the end-to-end data migration capability, ensuring data is migrated accurately, securely, and within critical programme timelines.\nThis is a senior data engineering and database-focused role and does not require Java or application development expertise.\nKey Responsibilities\nDesign and deliver the end-to-end data migration strategy for CRS.\nDevelop and implement ETL processes to Azure PostgreSQL to support data migration and future operational requirements.\nDesign and maintain logical and physical data models for the target platform.\nEstablish the data migration capability as the new platform becomes available.\nDefine and implement approaches for moving CRS data into staging and production database environments.\nDevelop robust processes for data extraction, transformation and loading.\nEnsure data quality, validation, reconciliation and governance throughout the migration lifecycle.\nSupport the migration and transformation of data required for 140+ operational reports.\nWork closely with business and technical stakeholders to understand reporting requirements.\nEnsure target data structures support both current and future reporting requirements.\nProvide technical leadership and oversight across data migration and data modelling activities.\nIdentify, assess and mitigate data migration risks.\nTroubleshoot complex data and database issues during migration.\nEnsure migration activities are delivered within agreed programme timescales.\nEstablish repeatable and maintainable migration processes for ongoing operational use.\nEssential Skills & Experience\nExtensive experience as a Senior / Lead Data Engineer with a strong focus on data migration.\nProven experience designing and delivering complex data migration solutions.\nStrong hands-on experience with ETL development and implementation.\nStrong experience working with Azure PostgreSQL.\nExcellent knowledge of relational databases and SQL.\nStrong experience in logical and physical data modelling.\nExperience designing database structures for operational and reporting requirements.\nStrong understanding of data quality, validation, reconciliation and governance.\nExperience migrating large or complex datasets between platforms.\nExperience designing staging and production data environments.\nStrong understanding of data transformation and mapping.\nExperience supporting reporting and analytics through well-designed data structures.\nAbility to provide technical leadership across data migration workstreams.\nStrong stakeholder management and communication skills.\nExperience identifying and managing data migration risks and dependencies.\nAzure / Data Platform Experience\nStrong experience with relevant Azure data platform technologies, particularly:\nAzure PostgreSQL\nAzure Data Factory / ETL tooling\nAzure Storage / Data Lake\nAzure database services\nAzure data integration and migration capabilities\nAzure monitoring and operational tooling\nData Engineering & Database Skills\nAdvanced SQL\nETL / ELT\nData migration\nData modelling\nDatabase design\nData transformation\nData mapping\nData validation\nData reconciliation\nData quality\nData governance\nPerformance optimisation\nReporting data structures\nRelational database technologies\nReporting Experience\nThe role will support the migration and transformation of data required for 140+ operational reports.\nExperience should therefore include:\nUnderstanding reporting data requirements.\nDesigning data structures to support operational reporting.\nData transformation for reporting purposes.\nData validation and reconciliation between source and target systems.\nSupporting reporting teams and business stakeholders.\nOptimising data structures for reporting performance.\nTechnical Leadership\nThe successful candidate will be expected to:\nTake ownership of the technical data migration approach.\nProvide guidance on data modelling and database design.\nReview migration and ETL solutions.\nIdentify technical risks and dependencies.\nWork collaboratively with technical architects, developers, reporting teams and business stakeholders.\nEstablish good engineering and data migration practices within the squad.\nDesirable Experience\nExperience working on large-scale government/public-sector data migration programmes.\nExperience migrating data from legacy platforms.\nExperience working with Actian or similar legacy database technologies.\nExperience with complex operational reporting environments.\nExperience working in Agile delivery teams.\nExperience with automated data validation and reconciliation.\nAzure certifications or relevant data engineering certifications.\nIdeal Candidate Profile\nThe ideal candidate will be a Lead/Senior Data Engineer or Database/Data Migration specialist who has hands-on experience taking ownership of complex data migration programmes, particularly where ETL processes, Azure PostgreSQL, data modelling, data quality and reporting are key components.\nDiversity and Inclusion\nAt Scrumconnect Consulting, we believe that diversity drives innovation. We are committed to creating an inclusive environment where every individual is respected, valued, and supported. We welcome applications from candidates of all backgrounds and experiences, and we actively encourage applications from women, people with disabilities, underrepresented communities, and those seeking flexible working arrangements.","description_format":"text","description_chars":6204,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services","Travel & Tourism","E-learning"],"lifecycle":[{"event":"open","at":"2026-10-20T13:00:11Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-10-24T06:24:00+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":12,"band":"cold","label":"Long shot","p_open":1,"p_active":0.334,"p_room":0.35,"age_days":31,"expected_fill_days":9,"reasons":["conf:0","stale_co","velocity","win:tail","comp:brand"],"computed_at":"2026-10-24T06:02:35Z"},"pay":null,"html_url":"https://alion.io/job/scrumconnect-lead-data-engineer-sc-cleared","json_url":"https://alion.io/job/scrumconnect-lead-data-engineer-sc-cleared.json","meta":{"generated_at":"2026-10-24T23:57:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":35153,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3861039},"rest":"https://alion.io/mcp/rest/get_company?id=3861039"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fscrumconnect-lead-data-engineer-sc-cleared"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fscrumconnect-lead-data-engineer-sc-cleared"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fscrumconnect-lead-data-engineer-sc-cleared"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/scrumconnect-lead-data-engineer-sc-cleared\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fscrumconnect-lead-data-engineer-sc-cleared"}]}