GCP Data Engineer with BigQuery

This is an onsite role and can sit either in Hyderabad, Chennai, Bengaluru, or Nagpur.

Data & Analytics Product Group under FCSD Tech is looking for a dynamic and result-oriented candidate for the role of Senior Data Engineer within its Data Orchestration product line. The candidate will be responsible for designing the transformation and modernization of big data solutions on the GCP cloud. The candidate must have experience leading large-scale solutions and the operationalization of data warehouses, data lakes, and analytics platforms on a cloud platform, with GCP preferred. We seek individuals with a wide range of technology skills in these domains, capable of designing the right solutions using a mix of GCP and third-party technologies for deployment on the GCP cloud.

Job Responsibilities for GCP Data Engineer:

• 8+ years of Data Engineering experience.
• 5+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
• Strong understanding of key GCP services, especially those related to data processing (batch/real time): BigQuery, Cloud Scheduler, Airflow, Postgres, Dataflow, Pub/Sub, Cloud Logging, and Cloud Monitoring.
• Experience with infrastructure as code using Terraform and GitHub.
• Experience in design, development, and implementation of data pipelines using data warehousing applications.
• Experience in integrating various data sources like Oracle, Teradata, DB2, BigQuery, and flat files.
• Hands-on experience in performance tuning and debugging ETL jobs.
• Involvement in review meetings and coordination with the team in job design and fine-tuning job performance.
• Responsible for validating, running, scheduling, and monitoring jobs using DataStage Director.
• Responsible for debugging ticketing issues in the production phase.

Skills

Airflow, BigQuery, Data Engineering, Dataflow, ETL, GCP, Google Cloud Platform, Terraform