Data Governance Engineer - BI & Planning, Shopee

We seek a Data Governance Engineer who will be responsible for establishing and maintaining data governance practices across our local data platform. This role will focus primarily (70%) on data governance initiatives including security management, query optimization, and resource allocation, while supporting (30%) analytics automation and pipeline maintenance.

Primary Responsibilities: Data Governance (70%)

Data Governance Framework

• Optimize data pipelines and SQL queries to ensure minimal resource consumption, high stability, and efficient performance across platforms such as HDFS, Presto, and Spark
• Establish and maintain continuous monitoring of governance scores, ensuring all teams achieve and sustain scores above 85/100, based on storage utilization and compute resource efficiency
• Develop governance policies and best practices tailored to local team needs

Data Service Management

• Integrate all VN reports and data pipelines to SLA Manager System for comprehensive resource tracking
• Lead optimization of resource allocation across all teams through performance monitoring and capacity planning
• Develop and manage Asset Status Tracker for complete visibility of data assets and project dependencies
• Implement and monitor failed task notifications, working with teams to establish Seatalk Failed Task Notifications

Data Quality & Performance

• Prioritize and implement quality rules for key tasks ensuring stable data resources
• Conduct regular query performance reviews and optimization sessions with Functional BI teams
• Establish data quality metrics and monitoring dashboards for proactive issue detection
• Lead troubleshooting efforts for data quality issues and performance bottlenecks

Security & Access Management

• Manage data access controls and security policies across all data platforms
• Conduct regular security audits and compliance reviews
• Work with Regional team to ensure alignment with global data governance standards

• Strong experience with data governance frameworks and best practices
• Hands-on experience with HDFS, Presto, Spark and distributed systems
• Proven track record in working with large distributed data warehouse systems and very-high data volume query optimization
• Strong SQL skills and understanding of data modeling & data warehouse management principles
• Knowledge of data security and access control management
• Excellent communication skills to work with both technical and business stakeholders.
• Experience with data quality tools and frameworks
• Experience with Python for automation and monitoring scripts
• Experience with Asset Status Tracking systems
• Knowledge of notification systems integration (Seatalk or similar)
• Background in implementing data governance in cross-functional environments
• LLM applications