Senior GCP Data Engineer - BigQuery & Data Pipelines
ITDS Poland
Hook -
Empower innovation at the intersection of data and cloud technology - build transformative solutions that drive global impact.
Location & Work Model
Krakow-based opportunity with hybrid work model (up to 3 remote days per week).
As a Senior GCP Data Engineer, you will be working for our client, a leader in financial services, on a large-scale data integration initiative. You will help design and deploy scalable data pipelines and models using Google Cloud Platform technologies, supporting a diverse set of users across the organization. This role offers a unique chance to influence cutting-edge data solutions and accelerate your professional growth in a dynamic environment.
Your main responsibilities:
- Design, develop, test, and deploy Google Cloud data models and transformations in BigQuery, utilizing SQL, stored procedures, indexes, clusters, and partitions.
- Create and manage ETL/ELT data pipelines, transforming raw and unstructured data into Data Vault universal models.
- Review and interpret complex business and technical requirements to deliver compliant, secure, and scalable data solutions.
- Monitor data pipelines and optimize performance for large data volumes, resolving failures and performance issues efficiently.
- Integrate data from multiple sources, ensuring high data quality and consistency.
- Manage code artifacts and implement CI/CD processes using Git, Jenkins, and Google Secrets Manager.
- Collaborate in an Agile environment, practicing DataOps methodologies to ensure continuous improvement.
You're ideal for this role if you have:
- At least 3 years of hands-on experience with SQL querying and optimization, specifically in BigQuery.
- Proven expertise in building and maintaining ETL/ELT pipelines in GCP, especially with Data Fusion.
- Demonstrable experience with Data Vault modelling and data integration techniques.
- Hands-on experience with Cloud Composer/Airflow, Cloud Run, and Pub/Sub.
- Proficiency in Python and Terraform scripting.
- Experience with Git, CI/CD processes, and tools like Jenkins or Ansible.
- Familiarity with DataOps practices and working within Agile teams.
- Strong problem-solving, organizational, and multi-tasking skills.
It is a strong plus if you have: (optional)
- Experience designing data ingestion pipelines with Data Fusion, CDAP, or similar tools handling CSV, JSON, XML, or API integrations.
- Development skills in Java, including custom plugin deployment for Data Fusion.
- Knowledge of modern data contract standards and best practices.
Language Required for the role :
English - communicative level, both written and spoken.
Eligibility to work on this role:
Only candidates with an existing legal right to work in the European Union will be considered.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.