{"id":4066431,"url":"https://alion.io/job/scrumconnect-consulting-data-engineer-sc-eligible-sc-cleared","title":"Data Engineer (SC Eligible/ SC Cleared)","company":{"id":3861039,"name":"Scrumconnect Consulting","domain":"scrumconnect.com","url":"https://alion.io/company/scrumconnect","size_band":"51-200","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":{"grade":"B","score":84,"open_postings":14,"ghost_share":0,"stale_share":0.643,"repost_share":0,"time_to_fill_p50_days":42,"computed_at":"2026-11-11T05:49:22Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Newcastle upon Tyne, United Kingdom"],"countries":["GB"],"hiring_countries":["GB"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Java","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"SQL","optional":false},{"name":"Airflow","optional":true},{"name":"Apache Kafka","optional":true},{"name":"CI/CD","optional":true},{"name":"Databricks","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-11T11:30:31Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T11:30:31Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About Scrumconnect\nScrumconnect Consulting is a multi-award-winning UK digital consultancy. We help public and private sector organisations design and deliver better digital services, working in agile, multidisciplinary teams on services used by millions of people every day. Our growing Newcastle office is at the heart of our presence in the North East.\nRole overview\nWe are looking for a Data Engineer to join us on a public sector project.You will build and maintain the data pipelines and platforms that power our digital services, making sure data is reliable, secure and ready for analysis.\nThis is a remote role with one day a week in our Newcastle office, where you will connect with the wider team. It suits someone looking for flexible, work without compromising on interesting, meaningful projects.\nKey responsibilities\nDesign, build and maintain scalable data pipelines (ETL/ELT) to collect, transform and load data from a range of sources.\n\nDevelop and manage data storage solutions, including data warehouses and data lakes.\n\nEnsure data quality, accuracy and consistency through validation, testing and monitoring.\n\nWork with Data Architects, Analysts and Developers to understand data needs and deliver reliable solutions.\n\nOptimise data workflows for performance, scalability and cost.\n\nFollow data security, privacy and governance standards.\n\nDocument pipelines, data models and processes clearly.\n\nTroubleshoot and resolve data issues quickly and effectively.\n\nEssential skills and experience\nProven experience as a Data Engineer or in a similar role.\n\nStrong SQL skills and experience with relational databases such as PostgreSQL, SQL Server or Oracle.\n\nProgramming experience in Python (or Scala or Java).\n\nExperience building ETL/ELT pipelines.\n\nExperience with cloud data platforms such as AWS or Azure (for example, S3, Glue, Redshift, Azure Data Factory or Synapse).\n\nUnderstanding of data modelling and data warehousing concepts.\n\nExperience with version control (Git).\n\nGood problem-solving and communication skills.\n\nAble to work independently and remotely, and to travel to Newcastle once a week.\n\nDesirable skills and experience\nExperience with Apache Spark, Databricks or Kafka.\n\nFamiliarity with orchestration tools such as Airflow.\n\nExperience with CI/CD for data pipelines and Infrastructure as Code.\n\nKnowledge of data governance and data quality frameworks.\n\nExperience in Agile delivery teams, ideally on public sector projects.\n\nWhat we offer\nFlexible part-time hours with mostly remote working.\n\nMeaningful work on digital services that make a real difference to the public.\n\nA growing, award-winning consultancy with a strong North East presence.\n\nOpportunities to learn new tools and grow your career.\n\nA collaborative, inclusive team where your ideas are valued.\n\nOur Commitment to Diversity & Inclusion\nAt Scrumconnect Consulting, we believe diversity drives innovation. We are committed to fostering an inclusive workplace where everyone feels respected, valued, and supported.\nWe actively encourage applications from women, people with disabilities, individuals from under-represented communities, and those seeking flexible working arrangements.\nAs a Disability Confident Level 1 employer, we provide reasonable adjustments throughout the recruitment process and employment to ensure equal opportunity for all.","description_format":"text","description_chars":3357,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Digital Government","IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-11T11:30:31Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"adverts_offering_sponsorship_24m":2,"sanctioned_now":false,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-11-11T07:38:50+00:00","sources":["UK Home Office: register of licensed sponsors (workers)","Alion: sponsorship offered in the employer's own job adverts (24 months)"],"filings_for_role_12m":0}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":42,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-11T13:16:14Z"},"pay":null,"html_url":"https://alion.io/job/scrumconnect-consulting-data-engineer-sc-eligible-sc-cleared","json_url":"https://alion.io/job/scrumconnect-consulting-data-engineer-sc-eligible-sc-cleared.json","meta":{"generated_at":"2026-11-11T13:16:14Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24070,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3861039},"rest":"https://alion.io/mcp/rest/get_company?id=3861039"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fscrumconnect-consulting-data-engineer-sc-eligible-sc-cleared"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fscrumconnect-consulting-data-engineer-sc-eligible-sc-cleared"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fscrumconnect-consulting-data-engineer-sc-eligible-sc-cleared"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/scrumconnect-consulting-data-engineer-sc-eligible-sc-cleared\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fscrumconnect-consulting-data-engineer-sc-eligible-sc-cleared"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4066431}},{"tool":"search_jobs","arguments":{"company":"scrumconnect.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4066431},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}