{"id":2728936,"url":"https://alion.io/job/software-mind-c3a-senior-data-platform-engineer-microsoft-fabric","title":"[C3A] Senior Data Platform Engineer (Microsoft Fabric)","company":{"id":7464,"name":"Software Mind","domain":"softwaremind.com","url":"https://alion.io/company/softwaremind","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":80,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":16,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":64000,"max_usd":96000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":72},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Bootstrap","optional":false},{"name":"ClickHouse","optional":false},{"name":"Delta Lake","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Power BI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"JavaScript","optional":true}],"status":"live","first_seen_at":"2026-10-16T13:02:42Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-17T01:22:30Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Software Mind develops solutions that make an impact for companies around the globe. Tech giants & unicorns, transformative projects, emerging technologies and limitless opportunities - these are a few words that describe an average day for us. Building cross-functional engineering teams that take ownership and crave more means we’re always on the lookout for talented people who bring passion and creativity to every project. Our culture embraces openness, acts with respect, shows grit & guts and combines cooperation with enjoyment.\n Project - the aim you’ll have\nClient is building a next-generation risk analysis and scoring platform on Microsoft Fabric, and this role owns its medallion data architecture end-to-end. You'll design and build Bronze / Silver / Gold Delta tables, Fabric Spark feature pipelines, Direct Lake semantic models, and physical-layout optimizations. This is our highest-utilization engineering role on the project - central to both Phase 1 platform foundation and Phase 2 risk product delivery, working alongside a Senior Technical Lead, Senior DevOps engineer, and mid-level developer.\nThe platform ingests transaction and merchant data from clients via SFTP and API, tokenizes sensitive PAN data at the ingestion boundary using our reserved-BIN HMAC-derived format-preserving scheme, and lands data in canonical Silver on Microsoft Fabric per our internal canonical spec. You'll build the pipeline that populates canonical Silver via MERGE, consume it via OneLake shortcuts, and materialize risk-specific Gold tables that feed both custom-authored DMN rules and pre-scored Mastercard Brighterion feeds.\nRole - how you’ll contribute\nDesign and implement Bronze, canonical Silver, and Gold Delta table schemas with PAN-safe physical layout - statistics allowlist configuration, liquid clustering, deliberate retention settings, V-Order optimization. \nBuild Fabric Spark notebooks for the feature pipeline (rolling velocity features across 24h / 7d / 30d windows, merchant-level rolling features, hierarchical rollups, cross-merchant features via pan_token joins). \nAuthor per-flavor-version Silver adapters - one function per flavor, unioned by name, tested against golden fixtures. \nBuild the canonical MERGE DAG (Bronze → canonical Silver, idempotent on _natural_key per Aperia's canonical Fabric internal spec v1.4). \nBuild the Gold materialization pipeline for both grains (fact_transaction_risk, fact_merchant_risk) with correct score-source stamping and idempotent merge semantics. \nDesign and implement Direct Lake semantic models per reporting surface; performance-test against representative data volumes. \nConfigure OneLake namespace layouts, workspace catalogs, and cross-workspace shortcut relationships with the residuals programme. \nEstablish idempotent Delta write patterns using delta-rs from Python containers (segmented parallel writes with single atomic commit). \nFabric capacity sizing (F-SKU selection, load testing, Reservation vs PAYG decisions). \nPartner with the DevOps engineer on Fabric IaC (Terraform capacity provisioning plus Fabric REST workspace bootstrap). \nConsult on ClickHouse contingency if Direct Lake latency proves insufficient for client-tier UIs. \n Expectations - the experience you need\n5+ years data engineering experience, with at least 2 years hands-on Spark development (PySpark preferred). \nDeep Delta Lake internals knowledge - transaction log format, checkpoints, retention settings (logRetentionDuration, deletedFileRetentionDuration), VACUUM, OPTIMIZE, deletion vectors, statistics collection. \nParquet format expertise - footers, statistics allowlists, row-group sizing, dictionary encoding, column indexes. \nMicrosoft Fabric hands-on experience - workspaces, capacities, notebooks, lakehouses, semantic models, Direct Lake, SQL analytics endpoint. \nSQL performance tuning skills for both OLAP (Fabric) and OLTP (PostgreSQL) workloads. \nStrong Python data engineering skills - pandas, PyArrow, delta-rs. \nAbility to communicate architecture clearly in writing and to work autonomously on well-scoped features. \nAdditional skills - the edge you have\nPCI-scoped data platform experience. \nFinancial services or payments domain background. \nPower BI semantic model authoring (DAX). \nFamiliarity with published data-standard governance patterns - logical model vs physical profile, SCD2 dimensions, natural-key idempotency, extension attribute stores. \nOneLake shortcuts and cross-workspace lakehouse patterns. \nClickHouse or similar OLAP engine familiarity. \nTerraform for Azure data resources. \nPrior experience with fluid or schema-flexible ingestion patterns. \n What we offer:\nFlexible and remote cooperation options\nInternational projects with leading global clients\nTravels related to international projects\nNon-corporate atmosphere\nAccess* to language classes\nAccess* to knowledge-sharing initiatives\nAccess* to private healthcare and life insurance\nAccess* to multisport card\n*The availability and terms of individual benefits may vary depending on the chosen form of cooperation.","description_format":"text","description_chars":5069,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Life insurance"],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-10-16T17:21:32Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":16,"reasons":["conf:2","win:early"],"computed_at":"2026-10-17T03:53:29Z"},"pay":null,"html_url":"https://alion.io/job/software-mind-c3a-senior-data-platform-engineer-microsoft-fabric","json_url":"https://alion.io/job/software-mind-c3a-senior-data-platform-engineer-microsoft-fabric.json","meta":{"generated_at":"2026-10-17T03:53:29Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5092,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7464},"rest":"https://alion.io/mcp/rest/get_company?id=7464"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsoftware-mind-c3a-senior-data-platform-engineer-microsoft-fabric"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsoftware-mind-c3a-senior-data-platform-engineer-microsoft-fabric"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsoftware-mind-c3a-senior-data-platform-engineer-microsoft-fabric"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/software-mind-c3a-senior-data-platform-engineer-microsoft-fabric\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsoftware-mind-c3a-senior-data-platform-engineer-microsoft-fabric"}]}