{"id":17396,"url":"https://alion.io/job/blackstone-eit-senior-data-platform-engineer","title":"Senior Data Platform Engineer","company":{"id":5155,"name":"Blackstone eIT","domain":"blackstoneeit.com","url":"https://alion.io/company/blackstone-eit","size_band":"501-1000","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":86,"open_postings":78,"ghost_share":0,"stale_share":0.577,"repost_share":0,"time_to_fill_p50_days":25,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dubai, United Arab Emirates"],"countries":["AE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":93000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2324},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Alembic","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CDS Views","optional":false},{"name":"dbt","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Grafana","optional":false},{"name":"Hadoop","optional":false},{"name":"Platform Engineering","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"SharePoint","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"ABAP","optional":true}],"status":"live","first_seen_at":"2026-04-10T00:00:00Z","employer_posted_date":"2026-04-10","last_verified_at":"2026-10-17T22:21:33Z","board_verified":true,"closed_at":null,"days_open":190,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":190},"description":"BlackStone eIT is seeking an experienced Senior Data Platform Engineer to lead the design, development, and maintenance of our enterprise data platforms. In this role, you will ensure that our data infrastructure is scalable, reliable, and optimized to support advanced analytics and business intelligence efforts.\nYou will work closely with data engineers, data scientists, and IT teams to develop robust data platforms that facilitate seamless data ingestion, processing, storage, and accessibility. This is an opportunity to make significant contributions to BlackStone eIT’s data strategy and technological advancement.\nKey Responsibilities\nDesign, build, and maintain scalable data platforms to support diverse data workloads.\nDevelop and optimize ETL/ELT pipelines to ensure efficient data movement and transformation.\nCollaborate with cross-functional teams to translate business requirements into technical solutions.\nEnsure data platform security, governance, and compliance with relevant regulations.\nMonitor platform performance, troubleshoot issues, and implement improvements.\nProvide technical leadership and mentorship to junior data engineers.\nStay updated with the latest trends and technologies in data platform engineering.\n- Platform architecture: pipeline design patterns, orchestration strategy, infrastructure-as-code, monitoring stack\n- Enterprise data extraction: SAP FI/CO (budget, actuals, commitments via OData/RFC), Microsoft Graph API (SharePoint, M365), SuccessFactors OData API - you own the extraction approach and build the first pipelines yourself\n- Staging layer design: PostgreSQL staging schema, raw-to-clean transformation patterns, refresh strategies\n- Ingestion observability: logging standards, alerting on failures, monitoring dashboards for pipeline health\n- Data quality framework: defining quality checks, deciding what pauses a pipeline vs. what triggers a warning\n- Classification enforcement: working with the Governance Lead to embed automated classification tagging into every pipeline\n- Technical mentorship: setting standards and reviewing work for the Senior Data Platform Engineer\nRequirements\nBachelor’s or Master’s degree in Computer Science, Information Technology, or related field.\n8+ years of experience in data engineering, with a focus on data platform architecture and development.\nStrong proficiency in SQL and experience with relational and NoSQL databases.\nHands-on experience with cloud data platforms such as AWS, Azure, or Google Cloud.\nExperience with big data technologies like Hadoop, Spark, and data warehousing solutions.\nKnowledge of data governance, security, and compliance standards.\nExcellent problem-solving and communication skills.\nProven ability to lead technical projects and mentor team members.\nRequired Skills & Technologies\n- SAP data extraction: OData services, RFC/BAPI, SAP Data Services, or CDS views - hands-on experience pulling data from SAP FI/CO modules\n- Python - async data pipelines, background jobs, scheduled tasks\n- PostgreSQL - schema design, migrations (Alembic), query optimization, partitioning\n- Azure Data Lake Storage + Synapse Analytics\n- Microsoft Graph API - SharePoint, M365, organizational data\n- Apache Airflow or Azure Data Factory\n- dbt or equivalent for transformation and quality testing\n- Redis - queue management, TTL, cache invalidation\n- Observability - structured logging, Azure Monitor or Prometheus/Grafana\n- Docker - containerized pipeline jobs\n- Infrastructure-as-code (Terraform or equivalent)\nBenefits\n Paid Time Off\n Performance Bonus\n Training & Development","description_format":"text","description_chars":3591,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Systems Integrators","Custom Software Development","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-04-10T00:00:00Z"}],"visa":[],"liveness":{"score":6,"band":"cold","label":"Long shot","p_open":1,"p_active":0.22,"p_room":0.28,"age_days":190,"expected_fill_days":25,"reasons":["conf:3","stale_co","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/blackstone-eit-senior-data-platform-engineer","json_url":"https://alion.io/job/blackstone-eit-senior-data-platform-engineer.json","meta":{"generated_at":"2026-10-17T23:33:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1841,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5155},"rest":"https://alion.io/mcp/rest/get_company?id=5155"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fblackstone-eit-senior-data-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fblackstone-eit-senior-data-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fblackstone-eit-senior-data-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/blackstone-eit-senior-data-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fblackstone-eit-senior-data-platform-engineer"}]}