Cloud Data Engineer

• Work closely with data scientists, business analysts and other stakeholders to understand their data requirements and translate them into technical specifications and data models.
• Collaborate with data architects to design and implement cloud-based data solutions that align with business needs.
• Facilitate internal knowledge sharing to ensure team members are informed about the latest best practices.
• Implement scalable and robust data pipelines from various source systems.
• Apply business rules and transformations using SQL or Python.
• Secure data models applying object and row level security.
• Develop and document best practices and ensure they are effectively implemented across the team.
• Analyze and address issues related to data integrity, data design and both functional and technical aspects of the Cloud Data Warehouse.
• Communicate effectively about issues, solutions, and best practices with relevant stakeholders.
• Perform cost and performance-based optimization of data transfer processes.
• Continuously monitor and improve the efficiency and performance of data pipelines.

What we look for

• Bachelor’s degree and above in Computer Science, Software Engineering or similar.
• Minimum 5 years of related working experience with cloud data warehouse technologies, preferably Snowflake and/or Databricks.
• Experience working in international teams.
• Hands-on experience in data warehouse modelling preferably with data vault 2.0 and/or star schema.
• Good understanding of agile methodologies like SCRUM.
• Problem-solving attitude and excellent communication skills.
• In-depth understanding of relational databases (SQL) and ETL (Extract, transform, load) frameworks.
• Experienced in data staging with SQL and Python, data visualization with tools such as PowerBI, data integration using Apache NiFi, Theobald Universal Xtract, and Azure Data Factory, as well as orchestrating data pipelines with dbt and Apache Airflow.
• Excellent organizational skills with the ability to communicate project goals and objectives, project status and deliverables with senior executives.
• Participate with the management team in developing a vision and strategic plan to guide the organization.

Please contact Ronald Heon Lon Yip for further information via [email protected] or +60 (4) 3053363.