Master Data Developer

Job Description:

• Design, build, and maintain robust ETL/ELT processes to ingest, transform, and deliver data across a modern Data Lake architecture
• Develop and optimize distributed data processing workflows using Python and PySpark to handle large-scale datasets efficiently
• Implement and refine partitioning strategies for data lake storage frameworks (such as Delta Lake or Apache Iceberg) to balance query performance with storage costs
• Write, optimize, and translate complex SQL queries involving CTEs, window functions, conditional expressions, and aggregations
• Migrate and modernize data pipelines from legacy RDBMS platforms to cloud-native analytics environments
• Work confidently with AWS-native services including Glue, Athena, and Redshift
• Collaborate with infrastructure and DevOps teams to provision and manage data resources using Infrastructure as Code (IaC) tools such as CloudFormation, CDK, or Terraform
• Monitor data pipeline health and performance using CloudWatch and other observability tools

Requirements:

• Solid experience working with ETL processes and data pipeline development with AWS
• Strong proficiency in Python as the primary programming language, with demonstrated experience writing and optimizing PySpark code for distributed data processing
• Thorough understanding of SQL, including complex queries (CTEs, window functions, aggregations, conditional expressions) and experience translating workloads from legacy RDBMS platforms
• Hands-on experience with AWS Glue (Jobs, Catalog, Triggers, Workflows), Athena, and Redshift
• Solid understanding of Data Lake architectures and partitioning strategies to optimize performance and cost
• Good understanding of object-oriented programming (OOP) principles and experience working with reusable code libraries
• Comfortable working with Git, Shell scripts, and Linux environments
• Familiarity with observability, monitoring, and metric tracking practices
• English Advanced/Fluent

Benefits:

• Premium Healthcare
• Meal voucher
• Maternity and Parental leaves
• Mobile services subsidy
• Sick pay-Life insurance
• CI&T University
• Colombian Holidays
• Paid Vacations