{"id":4458596,"url":"https://alion.io/job/datamatics-technologies-data-engineer-datamatics-technologies-14","title":"Data Engineer - Datamatics Technologies","company":{"id":4413925,"name":"Datamatics Technologies","domain":"datamaticstechnologies.com","url":"https://alion.io/company/datamaticstechnologies","size_band":"51-200","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Dubai, United Arab Emirates"],"countries":["AE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"GitHub","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-17T12:43:05Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T12:43:05Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Location: UAE-based (Travel required)\nDuration: 6-month assignment\nSummary (Data Engineer)\nTimely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.\nResponsibilities\nBuild batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.\nDevelop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.\nImplement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.\nIntegrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.\nEnsure that pipelines publish metadata and lineage to Microsoft Purview.\nImplement scheduling, dependency management, parameterization, error handling and alerting.\nOptimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.\nApply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.\nMaintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.\nSupport production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.\nMust Have\n4+ years in data engineering, preferably within UAE government or regulated-sector environments.\nAdvanced SQL, Python and PySpark/Spark skills.\nHands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.\nStrong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.\nExperience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.\nFamiliarity with Microsoft Purview metadata and lineage, and with DQ tooling.\nAwareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.\nExcellent English communication and documentation skills.\nGood to Have\nArabic proficiency is an advantage.","description_format":"text","description_chars":2598,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[{"language":"Arabic","level":"Advanced (C1)","optional":true},{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"United Arab Emirates","iso":"AE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cloud Consulting & Migration","IT Staffing & Staff Augmentation","Analytics & BI Consulting","Data Engineering & Migration Services"],"lifecycle":[{"event":"open","at":"2026-11-17T12:43:05Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":16,"reasons":["conf:1","win:early"],"computed_at":"2026-11-17T14:03:15Z"},"pay":null,"html_url":"https://alion.io/job/datamatics-technologies-data-engineer-datamatics-technologies-14","json_url":"https://alion.io/job/datamatics-technologies-data-engineer-datamatics-technologies-14.json","meta":{"generated_at":"2026-11-17T14:03:15Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":24496,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4413925},"rest":"https://alion.io/mcp/rest/get_company?id=4413925"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdatamatics-technologies-data-engineer-datamatics-technologies-14"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdatamatics-technologies-data-engineer-datamatics-technologies-14"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdatamatics-technologies-data-engineer-datamatics-technologies-14"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/datamatics-technologies-data-engineer-datamatics-technologies-14\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdatamatics-technologies-data-engineer-datamatics-technologies-14"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4458596}},{"tool":"search_jobs","arguments":{"company":"datamaticstechnologies.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4458596},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}