{"id":1270774,"url":"https://alion.io/job/alliance-bank-malaysia-berhad-data-engineer","title":"Data Engineer","company":{"id":2075118,"name":"Alliance Bank Malaysia Berhad","domain":"alliancebank.com.my","url":"https://alion.io/company/alliancebank","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kuala Lumpur, Malaysia"],"countries":["MY"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"BigQuery","optional":false},{"name":"CI/CD","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Hadoop","optional":false},{"name":"Informatica","optional":false},{"name":"Java","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Talend","optional":false}],"status":"live","first_seen_at":"2026-09-26T00:00:18Z","employer_posted_date":null,"last_verified_at":"2026-09-26T00:00:18Z","board_verified":false,"closed_at":null,"days_open":22,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":22},"description":"Key Responsibilities\n1.Data Pipeline Development & Integration\nDesign, build, and maintain scalable, reusable ETL/ELT pipelines for batch and real-time data processing\nIntegrate data from multiple internal and external sources (databases, APIs, streaming platforms, third-party systems)\nEnsure efficient data ingestion, transformation, and loading processes\n\n2. Data Modeling & Transformation\nDevelop and maintain logical and physical data models (e.g., dimensional models, star/snowflake schemas)\nTransform raw data into structured, analytics-ready datasets\nOptimize data structures for performance, scalability, and usability\n\n3. Data Quality & Reliability\nImplement data validation, cleansing, and enrichment processes\nEstablish data quality frameworks, including rules, checks, and monitoring\nTroubleshoot and resolve data inconsistencies, anomalies, and failures\nEnsure high availability and reliability of data pipelines\n\n4. Data Platform Utilization & Optimization\nWork with cloud data platforms (e.g., Azure, AWS, GCP) and data services (e.g., Synapse, BigQuery, Redshift)\nOptimize storage, query performance, and compute efficiency\nMonitor pipeline performance and continuously improve throughput and latency\n\n5. Collaboration & Data Enablement\nCollaborate with data analysts, data scientists, architects, and business stakeholders to understand data requirements\nProvide clean, well-structured datasets for reporting, dashboards, and machine learning use cases\nSupport self-service analytics by enabling easy data access and documentation\n\n6.Data Governance & Security\nImplement and adhere to data governance policies, standards, and best practices\nEnsure compliance with data privacy, security, and regulatory requirements\nManage data access controls, lineage, and auditability\n\n7. Automation & DevOps Practices\nAutomate data workflows using orchestration tools (e.g., Airflow, Azure Data Factory)\nImplement CI/CD pipelines for data engineering processes\nApply version control and infrastructure-as-code practices\nPromote reusable components and standardized frameworks\n\n8. Monitoring, Logging & Observability\nSet up monitoring, alerting, and logging frameworks for pipelines and datasets\nTrack data lineage, pipeline health, and system performance\nProactively identify and resolve production issues\n\n9. Documentation & Knowledge Sharing\nMaintain clear documentation for data pipelines, data models, and architecture\nDefine data definitions, metadata, and data catalogs\nShare knowledge and best practices across teams\n\n10. Continuous Improvement & Innovation\nStay current with emerging data engineering tools, technologies, and patterns\nRecommend and implement improvements in architecture, performance, and cost efficiency\nContribute to evolving enterprise data strategy and standards\n\nRequirement\nBachelor's degree in Computer Science, Engineering, Information Systems, or related field\nExperience with real-time data streaming and processing\nFamiliarity with containerization tools such as Docker and Kubernetes\nKnowledge of data modeling techniques (dimensional, star schema)\nExperience with CI/CD pipelines for data workflows\nUnderstanding of machine learning workflows and data preparation\nStrong programming skills in Python, Java, or Scala\nExperience with SQL and NoSQL databases\nHands-on experience with data pipeline tools (e.g., Apache Airflow, Talend, Informatica)\nFamiliarity with big data technologies (e.g., Hadoop, Spark, Kafka)\nExperience with cloud platforms such as AWS, Azure, or Google Cloud\nUnderstanding of data warehousing concepts (e.g., Snowflake, Redshift, BigQuery)\nKnowledge of version control systems (e.g., Git)","description_format":"text","description_chars":3653,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks"],"lifecycle":[{"event":"open","at":"2026-09-26T00:00:18Z"}],"visa":[],"liveness":{"score":47,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.731,"p_room":0.75,"age_days":21,"expected_fill_days":22,"reasons":["seen:21","velocity","win:late"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/alliance-bank-malaysia-berhad-data-engineer","json_url":"https://alion.io/job/alliance-bank-malaysia-berhad-data-engineer.json","meta":{"generated_at":"2026-10-18T22:38:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25389,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2075118},"rest":"https://alion.io/mcp/rest/get_company?id=2075118"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Falliance-bank-malaysia-berhad-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Falliance-bank-malaysia-berhad-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Falliance-bank-malaysia-berhad-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/alliance-bank-malaysia-berhad-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Falliance-bank-malaysia-berhad-data-engineer"}]}