{"id":2924056,"url":"https://alion.io/job/scrumconnect-azure-data-engineer","title":"Azure Data Engineer","company":{"id":3861039,"name":"Scrumconnect Consulting","domain":"scrumconnect.com","url":"https://alion.io/company/scrumconnect","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":{"grade":"B","score":80,"open_postings":24,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":9,"computed_at":"2026-10-26T05:57:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Newcastle, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":61000,"max_usd":139000,"period":"year","method":"role_country_seniority_unknown","sample_n":202},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"GitLab","optional":false},{"name":"GitLab CI","optional":false},{"name":"Terraform","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Databricks","optional":true}],"status":"live","first_seen_at":"2026-09-11T00:00:00Z","employer_posted_date":"2026-09-11","last_verified_at":"2026-10-26T11:52:55Z","board_verified":true,"closed_at":null,"days_open":45,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":45},"description":"About Scrumconnect Consulting\nScrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens.We are passionate about user-centred design, agile delivery, and building digital services that make a real difference. Our teams work at the forefront of innovation, helping organisations transform and deliver high-quality, scalable solutions that truly matter.\nRole Overview\nWe are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft Azure.\nYou will work closely with engineering, data, and delivery teams to build reliable data pipelines and cloud-based data platforms, while following best practices around infrastructure, automation, and source control.\nKey Responsibilities\nDesign, develop, and maintain scalable Azure data solutions and pipelines.\nBuild and manage data pipelines using Azure Data Factory (ADF).\nDevelop and optimise data solutions using Azure Synapse Analytics.\nWork with Azure Data Lake for data storage and processing.\nImplement and maintain cloud infrastructure using Terraform.\nUse GitLab for source control, version management, and CI/CD processes.\nMonitor, troubleshoot, and optimise data pipelines and Azure services.\nEnsure data solutions are secure, scalable, reliable, and maintainable.\nCollaborate with developers, data analysts, architects, and delivery teams.\nProactively identify technical issues and opportunities for improvement.\nContribute to automation and continuous improvement of engineering practices.\nEssential Skills & Experience\nStrong experience working with Microsoft Azure cloud services.\nHands-on experience with Azure Data Factory (ADF).\nStrong experience with Azure Synapse Analytics.\nExperience working with Azure Data Lake.\nHands-on experience with Terraform and Infrastructure as Code (IaC).\nExperience using GitLab, including GitLab CI/CD.\nStrong data engineering and data pipeline development experience.\nGood understanding of cloud-based data architecture and integration.\nStrong troubleshooting and problem-solving skills.\nProactive approach with the ability to work independently and as part of a team.\nGood communication and collaboration skills.\nNice to Have\nExperience with Databricks.\nExperience with Apache Kafka.\nExperience with Kafka Connect.\nKnowledge of event-driven data architectures and real-time data processing.\nKey Technologies\nAzure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect\nDiversity & Inclusion\nAt Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed to fostering an inclusive environment where every individual is valued, respected, and supported.\nWe welcome applications from candidates of all backgrounds and actively encourage individuals from underrepresented groups, including women, people with disabilities, and diverse communities, as well as those seeking flexible working arrangements.\nAs a Disability Confident Level 1 employer, we are committed to providing reasonable adjustments throughout the recruitment process and during employment to ensure equal opportunities for all.","description_format":"text","description_chars":3449,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services","Travel & Tourism","E-learning"],"lifecycle":[{"event":"open","at":"2026-10-20T13:00:11Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-10-24T06:24:00+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":1,"p_active":0.154,"p_room":0.28,"age_days":45,"expected_fill_days":9,"reasons":["conf:2","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/scrumconnect-azure-data-engineer","json_url":"https://alion.io/job/scrumconnect-azure-data-engineer.json","meta":{"generated_at":"2026-10-26T12:32:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17239,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3861039},"rest":"https://alion.io/mcp/rest/get_company?id=3861039"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fscrumconnect-azure-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fscrumconnect-azure-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fscrumconnect-azure-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/scrumconnect-azure-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fscrumconnect-azure-data-engineer"}]}