Vo Quang Duc

Modernized an enterprise data sourcing and ingestion framework processing about 1 TB per day by migrating AWS Glue workloads to Databricks. Designed Databricks Unity Catalog governance with automated PII classification, tagging, and column-level masking, enforcing fine-grained ABAC access controls. Replaced a Glue-based streaming pipeline with a Python Kafka consumer running on AWS EKS to load CDC messages into Delta tables with exactly-once semantics. Delivered and optimized Databricks ETL workflows for analytics and a serving layer, improving reliability and reducing runtime/cost.

Built, implemented, and operated a data ingestion platform and data service for reporting and BI usage. Maintained Kafka Connectors for CDC-based synchronization across big data platforms and enterprise applications. Developed Spark jobs and Java-based consumers to process, transform, and enrich Kafka streams for downstream analytics and real-time integration. Monitored and tuned Kafka to maintain high availability and low latency for streaming pipelines.