{"id":3701802,"url":"https://alion.io/job/arrow-global-data-engineer-2","title":"Data Engineer","company":{"id":669091,"name":"Arrow Global","domain":"arrowglobal.net","url":"https://alion.io/company/arrowglobal","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Pinpoint","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Manchester, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Git","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"MS SQL","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Azure SQL Database","optional":true},{"name":"Microsoft Entra ID","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-02T19:44:13Z","employer_posted_date":"2026-11-02","last_verified_at":"2026-11-06T19:56:52Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":4},"description":"We are seeking highly skilled and experienced Azure Data Engineers to join a newly formed group concentrating on Data. Within this role you will be a key member of the team, working on a complex and challenging project within the Financial Services/Capital Markets industry. The primary focus of the role would be on building resilient, reusable Data Pipelines to extract, load, and transform raw data into a relational data model. The successful candidate will work across complex, multi-source datasets including loan servicing systems, property and valuation platforms, collections systems, and third-party data providers, delivering reliable and auditable data at scale.\nKey Responsibilities\nBuild and maintain ingestion and transformation pipelines on Microsoft Fabric (Data Pipelines, PySpark notebooks, Dataflows Gen2) across the Landing, Curate and Enrich layers of the medallion architecture.\nOnboard new source systems by setting up the team’s reusable ingestion patterns (Fabric mirroring from Snowflake and SQL Server, change data capture, file and API loads). Do this through configuration rather than one-off code.\nWrite and tune PySpark and T-SQL for Lakehouse and Warehouse workloads, including fact and dimension models in the enterprise data warehouse.\nImplement data quality rules and validation pipelines, and help investigate and fix data issues found by DQ checks and reconciliations.\nWork through the team’s engineering workflow: Git-based development in Azure DevOps, pull requests and peer review, and CI/CD promotion from Dev to UAT to Production.\nContribute to the infrastructure-as-code (Terraform) and the orchestration config database (SQL projects / DACPAC) as needed.\nWork with Data Stewards, Data Analysts and the Data Architect to understand source data and turn mapping specs and business rules into working transformations.\nKeep documentation current, including source-to-target mappings, transformation rules and runbooks, so the work stays auditable and supportable.\nSupport the platform day to day: monitor pipeline runs, triage failures and escalate where needed.\nHelp prepare trusted datasets and Power BI semantic models for portfolio analytics, asset strategy, finance and risk.\nOur tech stack\n Platform: Microsoft Fabric (Lakehouse, Warehouse, Notebooks, Data Pipelines, Dataflows Gen2, Mirroring, OneLake)\nLanguages: Python / PySpark, Spark SQL, T-SQL\nSources: Snowflake, SQL Server, files and third-party feeds\n Azure: Azure SQL Database, ADLS Gen2, Key Vault, Data Factory, Entra ID (service principals and managed identities)\n Engineering: Azure DevOps (Repos, Pipelines, Boards), Git, fabric-cicd, Terraform / HCP Terraform, SQL Database Projects\n Governance and reporting: Microsoft Purview (data quality), Power BI (semantic models)\n\nAbout you\nExperience building data pipelines as a Data Engineer or in a similar role\nStrong Python/PySpark and SQL skills\nHands-on experience with Microsoft Fabric, or with Databricks / Azure Synapse / Azure Data Factory and a willingness to move to Fabric\nComfortable with Git, pull requests and CI/CD. Terraform or other infrastructure-as-code experience is a plus\nUnderstanding of data modelling (dimensional / medallion) and data quality practices\nWorks well in a team, takes feedback in code review, and is keen to learn and develop\nStrong analytical, verbal and written communication skills\nDegree in Computer Science, Information Systems, Data Science or a related field preferred\nExperience in financial data domains (loan servicing, transactions, reference data, IBOR/ABOR) or in Real Estate, Credit, Banking or NPL Asset Management is desirable\nMicrosoft certification (e.g. DP-700 Fabric Data Engineer) a plus","description_format":"text","description_chars":3705,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Asset Management & Funds","Debt Collection & Recovery"],"lifecycle":[{"event":"open","at":"2026-11-03T19:44:13Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Senior or Specialist Worker, Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Global Business Mobility: Senior or Specialist Worker; Skilled Worker","cap_exempt":false,"checked_at":"2026-11-06T06:20:25+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.901,"p_room":1,"age_days":3,"expected_fill_days":18,"reasons":["conf:3","velocity","win:early"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/arrow-global-data-engineer-2","json_url":"https://alion.io/job/arrow-global-data-engineer-2.json","meta":{"generated_at":"2026-11-06T20:20:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4516,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":669091},"rest":"https://alion.io/mcp/rest/get_company?id=669091"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Farrow-global-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Farrow-global-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Farrow-global-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/arrow-global-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Farrow-global-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3701802}},{"tool":"search_jobs","arguments":{"company":"arrowglobal.net","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3701802},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}