{"id":4073844,"url":"https://alion.io/job/margo-senior-data-platform-engineer","title":"Senior Data Platform Engineer","company":{"id":678262,"name":"Margo","domain":"margo.com","url":"https://alion.io/company/margo-5","size_band":"11-50","is_staffing_agency":false,"employer_type":"staffing","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"A","score":85,"open_postings":48,"ghost_share":0.167,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":226,"computed_at":"2026-11-11T05:49:22Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":{"min":180,"max":200,"currency":"PLN","period":"hour","gross":null,"usd_annual":102000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Least Privilege","optional":false},{"name":"Microsoft Entra ID","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-11T14:31:27Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T14:39:07Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture.\nThis role is focused on the platform itself. The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF), Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code, Databricks and Unity Catalog governance, observability and cost efficiency, while remaining hands-on and close to the teams that use the platform.\n\nMust Have\n\nKey Responsibilities\nOrchestration Platform (Apache Airflow & ADF)\nOwn the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards.\n\nWork on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns).\n\nEnsure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring and clear failure ownership.\n\nAzure Resource Management\nManage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking and supporting services.\n\nOwn secrets and identity management: Key Vault, service principals and managed identities, secret scopes and rotation.\n\nOwn access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege, plus access requests and periodic reviews.\n\nOwn Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state.\n\nTrack cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging).\n\nHands-on Data Platform evolution\nContribute to the implementation of the Data Catalog and Data Quality Framework and it’s lineage across the platform.\n\nDrive observability: pipelines that are observable, debuggable and alert-driven, with clear ownership of failures.\n\nOperate the Databricks platform: Unity Catalog structure, cluster and job policies, Auto Loader ingestion patterns, and performance and cost optimization of workloads.\n\nTechnical Leadership\nParticipate in architecture reviews and technical decision-making, stating trade-offs (performance, cost, reliability, complexity) with data.\n\nDefine and promote engineering standards: naming conventions, patterns and guidelines, through code reviews and design reviews.\n\nCollaborate with Architects, Product Owners and data engineers in technical maturation of data products.\n\nBuild and maintain developer tooling and automation, including AI-assisted engineering workflows (shared agent instructions, skills, automated PR review).\n\nSupport & Operations (Run Team Collaboration)\nProvide second-line support to the Run/Operations team for complex production topics.\n\nTroubleshoot and resolve platform incidents, failures and performance issues; lead root cause analysis and post-mortems.\n\nEnsure proper handover, documentation and operational readiness of platform changes.\n\nContinuously improve runbooks, monitoring and operational processes.","description_format":"text","description_chars":3282,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-11T14:39:07Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":226,"reasons":["conf:1","win:early"],"computed_at":"2026-11-11T15:45:52Z"},"pay":{"stated_usd_annual":102000,"is_top_pay":false},"html_url":"https://alion.io/job/margo-senior-data-platform-engineer","json_url":"https://alion.io/job/margo-senior-data-platform-engineer.json","meta":{"generated_at":"2026-11-11T15:45:52Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29467,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":678262},"rest":"https://alion.io/mcp/rest/get_company?id=678262"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmargo-senior-data-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmargo-senior-data-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmargo-senior-data-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/margo-senior-data-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmargo-senior-data-platform-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4073844}},{"tool":"search_jobs","arguments":{"company":"margo.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4073844},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}