First seen by Alion on Aug 19, 2026.
Generic Skills (Must Have) :
- Python and advanced SQL.
- Data quality checks, reconciliation, alerting, retries, and backfills.
- Production pipeline monitoring and troubleshooting.
GCP Skills (Must Have) :
- Mandatory : BigQuery : datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.
- Option 1 : Dataflow / Apache Beam or equivalent streaming/batch framework.
- Option 2 : Dataproc / PySpark or strong Spark experience.
- Pub/Sub or equivalent event streaming.
- Cloud Composer / Airflow DAG development.
Nice to have (Trainable) :
- Dataform, dbt, CI/CD for data.
- BigQuery ML.
- Dataflow templates.
- Looker / LookML basics.
- Terraform for data infrastructure.
Skills
Google Cloud Platform, Data Engineering, SQL, Python, PySpark, BigQuery, Apache Airflow, Data Build Tool

