{"id":3008269,"url":"https://alion.io/job/startup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance","title":"Senior Data Engineer / Data Architect – Azure Data Explorer, IoT streaming (Freelance)","company":{"id":1450,"name":"Startup House","domain":"startup-house.com","url":"https://alion.io/company/startup-house","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"freelance","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":73000,"max_usd":130000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":15},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Python","optional":false},{"name":"Time Series","optional":false},{"name":"Anomaly Detection","optional":true},{"name":"JavaScript","optional":true},{"name":"Nest.JS","optional":true},{"name":"Node JS","optional":true},{"name":"PostGIS","optional":true},{"name":"PostgreSQL","optional":true},{"name":"TypeScript","optional":true}],"status":"live","first_seen_at":"2026-10-21T12:13:56Z","employer_posted_date":null,"last_verified_at":"2026-10-21T12:13:56Z","board_verified":false,"closed_at":null,"days_open":6,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":6},"description":"We connect talented freelancers with cutting-edge projects, offering a platform for you to showcase your expertise and thrive in a collaborative environment.\n\nCurrently we are looking for a Senior Data Engineer with architect skills to join an environmental monitoring platform for industry. You'll take over a working proof of concept of a streaming IoT measurement pipeline on Azure and bring it to production – from edge devices, through the raw layer, to read-optimised data and rollups in Azure Data Explorer.\n\n Location: Remote/Warsaw Office\n Salary (PLN): 160-200 net + VAT (B2B)\n Start: November\n\nWhat will you do?\n• Take over the PoC and bring it to production – the data semantics are already defined, so you can focus on the pipeline.\n• Build the stream processor from Event Hubs to Azure Data Explorer.\n• Design and schedule the cascade of rollups and time-window aggregations.\n• Implement reprocessing of data after configuration changes.\n• Model and optimise ADX tables, update policies, materialized views, retention policies and queries for large data volumes.\n• Work closely with our PM, our ADX specialist, the client's engineering team and our DevOps.\n\nWhat we're looking for:\n\nMust-have:\n• At least 2–3 data pipeline projects taken from zero to production in the role of architect or lead data engineer, with Azure Data Explorer in production in at least one of them.\n\nExperience:\n• Senior experience in data engineering (around 5+ years), including IoT streams and time-series data\n• Broad, hands-on experience with Azure data services\n\nTech skills:\n• Azure Data Explorer (Kusto) and KQL: table modelling, update policies, materialized views, retention policies, query optimisation for large volumes\n• Streaming ingestion on Azure: IoT Hub, Event Hubs, parsing functions (e.g. Azure Functions), Blob Storage\n• Layered data architecture (raw/Bronze → Silver → aggregates), designing rollups and time-window aggregations\n• Python\n• Terraform\nSoft skills:\n• Independence – you can own a production pipeline end to end without hand-holding\n• At least B2 in English – we work internationally, so that's a must\n• Strong collaboration and communication skills – you'll work with several teams\n• Attention to detail\n\nNice-to-haves:\n• Environmental data (spectra, multi-parameter data, interval and event data)\n• Preparing data for ML (e.g. anomaly detection) and near-real-time queries\n• PostgreSQL/PostGIS and spatial data\n• Edge devices / edge computing\n• TypeScript/NestJS\n\nHow to apply\nAlong with your CV, please send a short description of 2–3 data pipelines you took to production. For each one: your role, scope, stack, data scale, what went wrong and what you would do differently – plus a link or reference if possible.\n\nNote: Please keep in mind that this is a part-time, freelance opening. \nTech stack\nData pipeline projects\nAzure Data Explorer\nStreaming ingestion\nLayered data architecture\nPython\nKQL\nTerraform\nIoT Hub","description_format":"text","description_chars":2943,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-21T14:25:25Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":5,"expected_fill_days":43,"reasons":["seen:5","win:early"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/startup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance","json_url":"https://alion.io/job/startup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance.json","meta":{"generated_at":"2026-10-27T21:19:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12599,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1450},"rest":"https://alion.io/mcp/rest/get_company?id=1450"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fstartup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fstartup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fstartup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/startup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fstartup-house-senior-data-engineer-data-architect-azure-data-explorer-iot-streaming-freelance"}]}