Senior Data Engineer

Senior Data Engineer responsible for driving implementation and optimization of centralized data repositories and data lake architectures, ensuring data quality, integrity and availability for analytics and business applications. The role involves designing and maintaining scalable data pipelines (ETL/ELT) across cloud and on-prem environments, providing technical guidance, and enabling data access for machine learning lifecycle from experimentation to production.

Responsibilities / Exposure:

• Drive the implementation and optimization of centralized data repositories and data lake architectures, supporting enterprise-wide analytics and reporting.
• Identify, diagnose, and resolve data-related issues, ensuring data quality, integrity, and availability for downstream analytics and business applications.
• Apply advanced data modeling techniques to solve real-world business challenges, ensuring data consistency, integrity, and performance.
• Provide advanced support and troubleshooting for data pipelines, ETL/ELT processes, and data integration workflows across cloud and on-prem environments.
• Enhance and mentor others in organizational, communication, and analytical skills, fostering a collaborative and data-driven engineering culture.
• Gain exposure to the end-to-end machine learning lifecycle, from experimentation to production, by enabling robust and scalable data access for model training and inference.

Key Responsibilities:

• Develop, optimize, and maintain robust data pipelines (ETL/ELT) across both on-premise and cloud environments.
• Work closely with business and technical teams to ensure that data mapping aligns with business rules and reporting needs.
• Maintain data lake and data warehouse solutions.
• Develop detailed reports and documentation of incidents and resolutions to contribute towards continuous improvement processes within the team.
• Provide technical guidance to the junior team and implement best practices and standards of code.
• Create and maintain data mapping documents to define the relationships between source data and target schemas.
• Develop and support the ingestion of data from multiple sources into a centralized data repository or data lake.
• Perform basic data cleaning, transformation, and validation to ensure data quality and integrity.

Title : Senior Data Engineer
Department : Data
Division : Technology
Location: Bangsar South, KL 

Requirements

Qualifications & Requirements:

• Minimum 5+ years of experience in data engineering, data warehousing, or big data environments.
• Strong understanding of data structures, performance tuning, and optimization.
• Strong proficiency in SQL and one or more programming languages (Python, Java, or Scala).
• Ability to troubleshoot and improve complex data workflows.
• Experience designing systems for scalability, reliability, and maintainability.
• Strong communication and documentation skills.
• Solid understanding of data governance, security, and compliance principles.
• Exposure to BI tools such as Power BI, Tableau, or Looker for data consumption and visualization.
• Exposure to Machine Learning projects implementation.
• Nice to have: Experience with streaming platforms.
• Malaysians only.

Skills

SQL, ETL/ELT, Data Modeling, Data Warehousing, Data Lake, Data Pipelines, Data Governance, Data Engineering, Data Engineering Scripting Language