{"id":4438398,"url":"https://alion.io/job/emirates-nbd-senior-data-engineer-etl-frameworks","title":"Senior Data Engineer - ETL Frameworks","company":{"id":1790062,"name":"Emirates NBD","domain":"emiratesnbd.com","url":"https://alion.io/company/emiratesnbd-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Doris","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"CI/CD","optional":false},{"name":"Data Vault","optional":false},{"name":"Hadoop","optional":false},{"name":"Kubernetes","optional":false},{"name":"OpenShift","optional":false},{"name":"Presto","optional":false},{"name":"pySpark","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-11-17T06:29:32Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T06:46:17Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"The Senior Data Engineer works closely with other Data Leads, Delivery Leads and Chapter head and help drive the Data Management and Analytics vision and strategy to deliver common, secure and consistent data capabilities across the EmiratesNBD Group. This role will involve strategic initiatives and reports into Head of Data Engineering Chapter and will manage the Data engineering, architecture and design of related approaches, tools and technologies.\nThe primary task is to drive and transform the data capabilities and enable a data-driven culture across the group and therefore work with other architects and platform teams to ensure data is managed as an asset in a centralized, standardized, and consistent manner in order to maintain consistency and quality, using mature technologies and emerging data practices.\nThis role requires an understanding of various data engineering, management and processing related technologies and choices, has a deep understanding of both SQL/No-SQL technologies, distributed computing framework, and techniques to make right tools and technology choices.\nAbility to design, develop and maintain high performant data pipelines \nGood understanding of source systems data structures, data retentions policies and data partitioning for modeling raw data vault structures\nDeep understanding of PySpark\nPerform deep performance tuning including:Spark execution plan analysis\nPartition optimization\nMemory tuning\nShuffle optimization\nJoin strategy optimization\nData skew handling\nExecutor tuning\nSerialization optimization\n\nDrive data reusability, reduce duplicity of data, minimizing adverse impact to performance\nCloudera Data Platform (CDP)\nHadoop ecosystem\nApache Iceberg\n Apache Doris\nKubernetes/OpenShift\nAlignment of data and information architecture with business objectives and priorities\n Participate in architecture discussions and contribute to enterprise-scale data engineering standards\nOutline short-term incremental solutions to achieve long-term objectives and an overall data management roadmap\nCreate data exchange standards to ensure reusability and a decoupled architecture\nCreate standards for data archival and purging\nDrive best practices around performance engineering, CI/CD, testing, and operational excellence\nDevelop data access matrix and ensure right information reaches the right people through secured channels\nDevelop strategy to align with external regulatory requirements\nIdentify and document critical data elements across source system of records\nDefine and document the data quality rules and standards\nAssess and define data governance and stewardship maturity roadmap\n Work with data engineers and source system experts to define the standards and principles for capturing lineage and data flow\nDefine data exception handling processes\nDefine standards for data pipeline scheduling and monitoring \nProvide technical recommendations and engage with data engineers and BI leads throughout the solutioning and implementation lifecycle\nRecommend effective solutions to develop high performant and scalable data pipelines\nWork with source system expertise to understand the data domains and source to target mapping \nBuild and maintain canonical datamodel to standardize data exchange between systems and with various architects to enforce the same#LI-SA1\n\n Master or Bachelor’s degree in computer science, information systems management or related field\nMore than 8+ years of experience in information technology, with 3+ years spent in data engineering, architecture and technology solutions definitions and implementations\nExtensive experience in banking and financial services domainStrong problem solving, influencing, communication, and presentation skills, self-starter\n\nStrong hands-on expertise in programming on PySpark\nExperience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.)\nExposure to designing and developing reusable frameworks for enabling scalable and performant data pipelines\nExperiences in cloud native principals, designs and deployments.\nExtensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments\nExpertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival\nDefine workload migration strategies using appropriate tools\nDrive delivery in a matrixed environment working with various internal IT partners\nDemonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously\nMust be able to work independently and have skills in planning, strategy, estimation, scheduling,","description_format":"text","description_chars":4710,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks"],"lifecycle":[{"event":"open","at":"2026-11-17T06:46:17Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":16,"reasons":["conf:1","win:early"],"computed_at":"2026-11-17T07:54:33Z"},"pay":null,"html_url":"https://alion.io/job/emirates-nbd-senior-data-engineer-etl-frameworks","json_url":"https://alion.io/job/emirates-nbd-senior-data-engineer-etl-frameworks.json","meta":{"generated_at":"2026-11-17T07:54:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14216,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1790062},"rest":"https://alion.io/mcp/rest/get_company?id=1790062"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Femirates-nbd-senior-data-engineer-etl-frameworks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Femirates-nbd-senior-data-engineer-etl-frameworks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Femirates-nbd-senior-data-engineer-etl-frameworks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/emirates-nbd-senior-data-engineer-etl-frameworks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Femirates-nbd-senior-data-engineer-etl-frameworks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4438398}},{"tool":"search_jobs","arguments":{"company":"emiratesnbd.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4438398},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}