Senior Data Engineer

Job Purpose

Data Engineer is responsible for handling the design and construction of scalable data management system including data storage, data piping, ETL and interfacing with analytics platforms. The jobholder needs to manage all data aspects related to public cloud solution, data lake, data warehouse, reporting, etc. The job holder is also required to participate in gathering data requirements, modelling, and testing as well as define flow of data in a project from input through to storage including interfaces with analytics tools or end user software.

Key Accountabilities

• Providing technical guidance related to data architecture, data models and meta data management to IT function and imitative leaders
• Define and implement data flows through/ and around digital products
• Participate in data modeling and testing to ensure smooth operations
• Extract relevant data to solve analytical problems, and ensure development teams have the required data
• Interact with the initiative leaders to understand all data requirements used for business insights development, and translates into data structures and data model requirements to IT function
• Develop set processes for data profiling, data quality, data transformation, data mining and data protection.
• Work closely with database teams on topics related to data requirements, cleanliness, accuracy, and etc.,
• Track analytics impact on business, and provide recommendation for better result
• Monitor market watch, and provide recommendation to improve efficiency of current projects

Professional Knowledge & Experiences

• Bachelor’s Degree in computer science, statistics, or related technical discipline
• 5+ years’ experience with advanced data management system and master data management
• Experience in developing applications in high volume data staging/ ETL environments and proficient in advanced SQL skills, Python programming and familiar with pandas scikit-learn, matplotlib, numpy, dash library.
• Experience in using Data Analytics products such as BigQuery, Apache Kafka, Apache Airflow, Cloud Storage, etc.
• Clear understanding in different data domains of operations, customers, etc.
• Ability to quickly learn new technologies

Additional Desirable Qualification

CORE Competencies