{"id":4172188,"url":"https://alion.io/job/collinson-data-engineer","title":"Data Engineer","company":{"id":1593,"name":"Collinson","domain":"collinsongroup.com","url":"https://alion.io/company/collinson","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":76,"open_postings":21,"ghost_share":0,"stale_share":0.952,"repost_share":0,"time_to_fill_p50_days":30,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon ECS","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Fargate","optional":false},{"name":"CI/CD","optional":false},{"name":"Datadog","optional":false},{"name":"dbt","optional":false},{"name":"Docker","optional":false},{"name":"Flink","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"PagerDuty","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Java","optional":true}],"status":"live","first_seen_at":"2026-11-12T15:03:22Z","employer_posted_date":"2026-11-12","last_verified_at":"2026-11-12T15:03:22Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Description\nilities\nBuild Data Pipelines: Develop, maintain and troubleshoot data pipelines using Python, SQL, Snowflake and dbt. \nManage Snowflake: Create and maintain tables, views and access permissions, while improving performance. \nKafka & Streaming: Work with Kafka topics, schemas and connectors to manage real-time data movement. \nManage AWS Infrastructure: Use Terraform to deploy and maintain AWS resources and other cloud platform services. \nAutomate Processes: Write Python scripts, create automated tests and manage CI/CD deployments using GitHub Actions. \nFix Production Issues: Monitor pipelines and platform services, investigate failures, resolve incidents and participate in on-call support. \nMaintain Security and Reliability: Follow security standards, manage access controls and improve platform stability and costs. \nParticipate in the on-call rota, diagnose production issues, coordinate incident response, and drive post-incident actions that prevent recurrence. \nMaintain runbooks, architecture records and operational documentation for the services and workflows you own. \nContribute to agile planning, technical design and code reviews, and collaborate effectively with engineers and stakeholders across distributed teams. \nKnowledge, skills and experience required\nOur core platform stack includes Python and SQL; Snowflake and dbt; Confluent Cloud (Kafka, Schema Registry, Flink SQL and ksqlDB); AWS; Terraform; MongoDB Atlas; SnapLogic; Datadog and PagerDuty; GitHub Actions; Docker and ECS/Fargate; and JSON Schema data contracts with policy-as-code controls.\nRequired:\nA university degree in computer science, engineering or a related discipline, or equivalent practical experience. \nAt least 4-5 years of hands-on Data Engineering \nStrong Python and SQL skills, with experience writing production code. \nPractical experience with Snowflake and confluent for data transformation \nHands-on experience with AWS and Terraform. \nUnderstanding of Kafka, including topics, consumers and data streaming. \nExperience with Git, CI/CD and automated testing. \nAbility to troubleshoot data pipelines and production issues independently. \nUnderstanding of cloud security, monitoring and access management. \nGood communication, problem-solving and teamwork skills. \nNice to have:\nStream processing with Flink SQL or ksqlDB; Java for Flink user-defined functions is an advantage. \nAdministration or integration experience with MongoDB Atlas, SnapLogic or AWS DMS, including deployment, monitoring, migrations, backup and recovery. \nObservability, incident response and delivery automation using Datadog, PagerDuty and GitHub Actions. \nDocker, ECS/Fargate and AWS networking, including PrivateLink or Transit Gateway, with a focus on resilience, capacity and cost. \nJSON Schema, data contracts and policy-as-code controls using OPA or Conftest. \nAI-assisted software development tools and practices that improve delivery speed and quality, supported by appropriate review, testing, security and governance controls. \nWe welcome applicants with diverse perspectives, career paths and equivalent experience.","description_format":"text","description_chars":3125,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Loyalty Programs","Property & Casualty Insurance","Business Travel"],"lifecycle":[{"event":"open","at":"2026-11-12T15:03:22Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","win:early"],"computed_at":"2026-11-12T16:48:13Z"},"pay":null,"html_url":"https://alion.io/job/collinson-data-engineer","json_url":"https://alion.io/job/collinson-data-engineer.json","meta":{"generated_at":"2026-11-12T16:48:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":35228,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1593},"rest":"https://alion.io/mcp/rest/get_company?id=1593"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcollinson-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcollinson-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcollinson-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/collinson-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcollinson-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4172188}},{"tool":"search_jobs","arguments":{"company":"collinsongroup.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4172188},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}