Senior Data Engineer

Key Responsibilities

• Architect & Model: Design, implement, and maintain scalable data models using Star, Snowflake, and Data Vault methodologies.
• Optimize BigQuery: Write, refactor, and optimize complex, highly efficient SQL queries with a strong focus on cost reduction, execution time, and concurrency.
• Build ELT/ETL Pipelines: Design, test, and deploy robust data ingestion and transformation pipelines (primarily using GCP Data Fusion / Apache Airflow).
• Integrate Diverse Sources: Connect and wrangle data from various sources, including RESTful/SOAP APIs and SFTP servers, handling formats like JSON, CSV, and XML.
• Drive DataOps Culture: Collaborate within an Agile framework using Git and CI/CD pipelines to ensure automated testing and continuous delivery of data solutions.

Technical Requirements

• 3+ years of expert-level SQL & BigQuery hands-on experience (complex optimization, cost control, data integrity).
• 3+ years of experience in ELT/ETL pipeline development using GCP Data Fusion (highly preferred) or Apache Airflow.
• Strong expertise in Data Modeling & Architecture - deep understanding of Kimball/Inmon concepts and hands-on experience with Data Vault (major plus).
• API & Data Ingestion proficiency - proven track record of ingesting and parsing JSON, XML, and CSV data from REST/SOAP endpoints.
• Git & CI/CD fluency - practical knowledge of version control and continuous testing/delivery tools in cloud environments.