{"id":3607775,"url":"https://alion.io/job/hellokindred-data-engineer-3","title":"Data Engineer","company":{"id":4311,"name":"HelloKindred","domain":"hellokindred.com","url":"https://alion.io/company/hellokindred","size_band":"51-200","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"contractor","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Glasgow, United Kingdom"],"countries":["GB"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":null,"max":205,"currency":"GBP","period":"day","gross":null,"usd_annual":69000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"CI/CD","optional":false},{"name":"Docker","optional":false},{"name":"GitLab","optional":false},{"name":"Platform Engineering","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Trino","optional":false},{"name":"Amazon S3","optional":true},{"name":"AWS","optional":true},{"name":"Helm","optional":true},{"name":"JavaScript","optional":true},{"name":"Kubernetes","optional":true},{"name":"OpenShift","optional":true},{"name":"React.js","optional":true}],"status":"live","first_seen_at":"2026-11-02T09:03:04Z","employer_posted_date":"2026-11-02","last_verified_at":"2026-11-08T02:35:36Z","board_verified":true,"closed_at":null,"days_open":5,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":5},"description":"Who is HelloKindred?\nHelloKindred are specialists in staffing marketing, creative and technology roles, offering a range of talent solutions that can be delivered on-site, remotely or hybrid.\nOur vision is to make work accessible and people’s lives better. We do this by disrupting traditional employment barriers - connecting ambitious talent to flexible opportunities with trusted brands.\n Anticipated Contract End Date/Length: December 31, 2026\nWork set up: Hybrid (2-3 days per week in office)\nClearance required: BPSS checks. Candidates must be eligible for BPSS clearance\nOur client in the Information Technology and Services industry is looking for a Data Engineer with strong Spark, Scala, and Python skills to develop, maintain, and troubleshoot data orchestration workflows and reusable engineering components. The role will support the processing, transformation, validation, and delivery of large-scale financial datasets, while contributing to platform engineering, production support, monitoring, automation, and operational resilience. The successful candidate will work across application, platform, database, infrastructure, and downstream teams to maintain reliable data processes and ensure compliance with technology, security, and change standards.\nResponsibilities\nDevelop, maintain, and troubleshoot data orchestration workflows using Apache Airflow for extract generation, data publishing, feed delivery, and operational batch processes.\nBuild and support reusable engineering components using Python, Scala, and Sharedview Spark to process, transform, and validate large-scale financial datasets.\nDesign, write, and optimize SQL/PostgreSQL and Starburst/Trino queries for metadata processing, data validation, reconciliation, and operational investigation.\nSupport Output Gateway production issues, including failed DAGs, delayed extracts, missing files, data mismatches, checksum failures, logs, status updates, and downstream delivery exceptions.\nContribute to platform engineering and release activities using GitLab, Docker, and controlled CI/CD practices across DEV, UAT, and production-like environments.\nEnhance monitoring, logging, alerting, audit tracking, and automation to improve operational stability, supportability, and evidence for control processes.\nWork with application, platform, database, infrastructure, and downstream teams to diagnose issues end-to-end and implement safe, controlled fixes.\nMaintain a strong risk and control mindset by ensuring changes are tested, reviewed, documented, and released in accordance with technology, security, and change standards.\n Strong skills and experience in data engineering using Spark, Scala, and Python.\nExperience developing, maintaining, and troubleshooting Apache Airflow workflows for data orchestration and operational batch processes.\nHands-on experience building reusable engineering components to process, transform, and validate large-scale financial datasets.\nProficiency in SQL and PostgreSQL, including query design, optimization, metadata processing, data validation, and reconciliation.\nExperience supporting production data workflows and troubleshooting failed DAGs, delayed extracts, missing files, data mismatches, checksum failures, and downstream delivery exceptions.\nFamiliarity with GitLab, Docker, and controlled CI/CD practices across development, UAT, and production-like environments.\nUnderstanding of monitoring, logging, alerting, audit tracking, and automation to improve operational stability and supportability.\nAbility to collaborate with application, platform, database, infrastructure, and downstream teams to diagnose and resolve technical issues.\nStrong awareness of risk, controls, testing, documentation, and technology, security, and change standards.\nDesirable Skills / Preferred Qualifications\nExperience with Starburst/Trino, AWS S3 concepts, and distributed query behavior for large-dataset validation and troubleshooting.\nExposure to React JS or API-driven operational user interfaces for configuration, monitoring, and support workflows.\nFamiliarity with OpenShift, Kubernetes, Helm, or container platform deployments in enterprise environments.\nUnderstanding of financial data controls, auditability, reconciliation, data lineage, operational resilience, and data quality expectations.\n All your information will be kept confidential according to EEO guidelines.\nCandidates must be legally authorized to live and work in the country where the position is based, without requiring employer sponsorship.\nHelloKindred is committed to fair, transparent, and inclusive hiring practices. We assess candidates based on skills, experience, and role-related requirements.\nWe appreciate your interest in this opportunity. While we review every application carefully, only candidates selected for an interview will be contacted.\nHelloKindred is an equal opportunity employer. We welcome applicants of all backgrounds and do not discriminate on the basis of race, colour, religion, sex, gender identity or expression, sexual orientation, age, national origin, disability, veteran status, or any other protected characteristic under applicable law.","description_format":"text","description_chars":5171,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United Kingdom","iso":"GB","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-02T12:27:46Z"}],"visa":[],"liveness":{"score":54,"band":"ok","label":"Likely open","p_open":1,"p_active":0.54,"p_room":1,"age_days":4,"expected_fill_days":19,"reasons":["conf:4","agency","velocity","win:early"],"computed_at":"2026-11-07T05:47:08Z"},"pay":{"stated_usd_annual":69000,"is_top_pay":false},"html_url":"https://alion.io/job/hellokindred-data-engineer-3","json_url":"https://alion.io/job/hellokindred-data-engineer-3.json","meta":{"generated_at":"2026-11-08T05:14:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11342,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-09T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4311},"rest":"https://alion.io/mcp/rest/get_company?id=4311"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fhellokindred-data-engineer-3"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fhellokindred-data-engineer-3"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fhellokindred-data-engineer-3"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/hellokindred-data-engineer-3\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fhellokindred-data-engineer-3"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3607775}},{"tool":"search_jobs","arguments":{"company":"hellokindred.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3607775},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}