Senior Data Engineer - Snowflake

Job description:

Key Accountabilities:

• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading.
• Utilize Python for advanced data processing, automation tasks, and integration with other systems.
• Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
• Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Implement advanced techniques for performance tuning methodologies in Snowflake to optimize query performance and reduce data processing time.
• Develop and maintain DBT models, macros, and tests for managing data transformations in Snowflake.
• Manage version control using Git repositories, enabling seamless code management and collaboration.
• Design, implement, and maintain automated CI/CD pipelines using Azure DevOps for Snowflake and DBT deployment processes.
• Impacts the effectiveness of own work team through the quality and timeliness of the work produced.
• Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.

Qualifications:

• Bachelor's/master's degree in Computer Science, Information Technology, or a related field.

Experience:

• Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
• Significant industry experience working with DBT (Data Build Tool) for data transformation.
• Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
• Deep understanding of data modelling techniques (OLTP, OLAP) and best practices.

CANDIDATE'S PROFILE:

Work Experience:

• Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
• Significant industry experience working with DBT (Data Build Tool) for data transformation.
• Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
• Deep understanding of data modelling techniques (OLTP, OLAP, DBT) and best practices.

Preferred Qualifications:

• Experience in working with large datasets and performance tuning in Snowflake.
• Familiarity with data governance, data security best practices, and compliance standards.
• Knowledge of additional data technologies (e.g., AWS, Azure) is a plus.
• Experience in leading projects or mentoring junior developers is advantageous.

Skills

Python, SQL, Snowflake