Data Engineer
First seen by Alion on Aug 22, 2026.
About the Role :
We are looking for a Data Engineer with 3 - 7 years of experience to design and build scalable, production-grade data solutions on GCP. The ideal candidate should have strong expertise in BigQuery, SQL, Dataform/dbt, Cloud Composer/Airflow, Dataflow/Apache Beam, and Spark, along with experience in modern data architecture, data quality, and cloud optimization.
Key Responsibilities :
- Design and implement scalable batch, incremental, and streaming data pipelines on GCP.
- Develop and optimize complex data transformations using BigQuery, SQL, and Dataform/dbt.
- Build reusable, metadata-driven, and configuration-driven data engineering frameworks.
- Design orchestration workflows using Cloud Composer/Apache Airflow, including dependencies, retries, scheduling, and recovery mechanisms.
- Develop distributed and streaming data processing solutions using Dataflow/Apache Beam and Dataproc/Spark.
- Define and implement standards for data modelling, schema design, schema evolution, and data contracts.
- Work with modern analytical storage technologies, including Apache Iceberg.
- Establish frameworks for data quality, reconciliation, metadata, lineage, and observability.
- Optimize large-scale data workloads for performance, scalability, latency, and GCP cost efficiency.
- Define and implement engineering standards for testing, version control, CI/CD, and production readiness.
- Conduct technical design and code reviews and provide guidance on complex implementation decisions.
- Identify technical debt and drive improvements to shared data platform capabilities.
- Collaborate with Data Engineering, Platform Engineering, DevOps, Architecture, Governance, and Product teams.
- Own solutions from technical design through production deployment and operational stability.
Required Skills :
- 3 - 7 years of experience in Data Engineering or related roles.
- Strong hands-on experience with GCP data services.
- Strong expertise in BigQuery and advanced SQL.
- Experience with Dataform or dbt.
- Hands-on experience with Cloud Composer/Apache Airflow.
- Experience with Dataflow/Apache Beam and/or Dataproc/Spark.
- Strong understanding of data modelling, schema evolution, data quality, and data pipelines.
- Experience with batch and streaming data processing.
- Understanding of CI/CD, testing, version control, monitoring, and production support.
- Exposure to Apache Iceberg and modern data lakehouse architectures is preferred.
- Strong problem-solving, technical design, and communication skills.
Skills
Data Engineering, Google Cloud Platform, BigQuery, SQL, Apache Airflow, Data Pipeline, Data Build Tool, Spark, DataLake