AP Data Engineer

Job Summary

This role focuses on designing and optimizing robust data platforms using Apache Iceberg for a hi tech environment ensuring reliable data ingestion storage and access for analytics teams. The professional will work from office in a day shift collaborating with product and engineering partners to deliver scalable data solutions that improve decision making and support innovative digital services for global stakeholders.

Responsibilities

• Design and implement highly scalable data lake and warehouse solutions using Apache Iceberg to support complex analytics and reporting needs in a hi tech product ecosystem.
• Develop efficient batch and streaming data pipelines that ensure accurate ingestion transformation and partitioning of large data volumes while maintaining strong data quality standards.
• Optimize data storage layouts file formats and metadata management within Apache Iceberg environments to achieve improved query performance and resource utilization.
• Collaborate closely with product managers data analysts and software engineers to translate business requirements into well structured data models and reliable data services.
• Establish robust data governance practices including schema evolution strategies data retention rules and catalog management to maintain consistent and compliant datasets.
• Implement monitoring and alerting for data workflows by configuring metrics logs and health checks that proactively identify data integrity or performance issues.
• Create clear technical documentation covering data architecture diagrams pipeline specifications and operational procedures to support knowledge sharing and smooth onboarding.
• Support performance tuning activities by analyzing query patterns optimizing joins and aggregations and refining clustering strategies within the data platform.
• Coordinate with security and compliance teams to embed access controls encryption mechanisms and audit trails that protect sensitive information in line with hi tech industry expectations.
• Provide guidance to stakeholders on using curated datasets and semantic layers effectively so that analytics outcomes directly contribute to product innovation and customer experience improvements.
• Contribute to continuous improvement initiatives by evaluating emerging data technologies compatible with Apache Iceberg and proposing practical enhancements to the existing stack.
• Engage in cross functional discussions to ensure data solutions align with organizational objectives and create positive impact on digital services offered to society.
• Participate in on site collaboration sessions during regular day shifts to resolve data issues quickly and maintain high availability of critical analytical datasets.

Qualifications

• Bring strong hands on experience working with Apache Iceberg in production environments including design of tables partitions and snapshot management for reliable data storage.
• Demonstrate solid knowledge of data engineering concepts such as ETL development distributed processing and data modeling using tools common in modern data platforms.
• Apply practical expertise in hi tech domains such as software products or digital platforms by understanding typical data patterns telemetry needs and user analytics requirements.
• Utilize proficiency in English and Chinese Mandarin communication to collaborate effectively with global stakeholders through clear documentation and discussion in both languages.
• Exhibit experience with cloud or on premises data infrastructure administration that supports secure scalable and cost conscious deployment of analytical workloads.
• Show familiarity with data governance and quality frameworks that help enforce standards for accuracy completeness and timeliness across critical business datasets.
• Display capability to work fully from office during day shifts while coordinating closely with team members to deliver predictable and high quality data engineering outcomes.

Certifications Required

Preferred certifications include Apache Iceberg specialist training or vendor data engineering certification such as a cloud provider data engineer credential.