{"id":158988,"url":"https://alion.io/job/deutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform","title":"Senior Data Engineer - GCP Data Platform","company":{"id":409,"name":"Deutsche Telekom Digital Labs","domain":"dtdl.in","url":"https://alion.io/company/deutsche-telekom-digital-labs","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Gurgaon, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":47000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"CI/CD","optional":false},{"name":"dbt","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Platform Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-08-29T01:43:24Z","employer_posted_date":null,"last_verified_at":"2026-08-29T01:43:24Z","board_verified":false,"closed_at":null,"days_open":53,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":53},"description":"We are looking for a hands-on Senior Data Engineer to design and build scalable data solutions and reusable data platform capabilities on Google Cloud Platform (GCP). This role combines data engineering and data platform engineering. You will provide technical leadership for complex data-processing capabilities while remaining actively involved in architecture, design, and implementation. You will help define how data products are transformed, orchestrated, governed, and operated at scale, with a strong focus on reusability, automation, performance, reliability, and engineering standards.\nResponsibilities:\nOwn the technical design and architecture of scalable data-processing and transformation solutions on GCP.\nDesign and build production-grade batch, incremental, and streaming data pipelines.\nDevelop and optimize complex transformations using BigQuery, SQL, and Dataform/dbt.\nBuild reusable, metadata-driven, and configuration-driven frameworks that reduce bespoke pipeline development.\nDesign orchestration patterns using Cloud Composer / Apache Airflow, including dynamic workflows, dependencies, retries, and recovery.\nDevelop distributed and streaming processing solutions using Dataflow / Apache Beam and Dataproc / Spark.\nDefine standards for data modeling, schema design, schema evolution, and data contracts.\nDesign and evolve modern analytical storage patterns, including Apache Iceberg.\nEstablish engineering patterns for data quality, reconciliation, metadata, lineage, and observability.\nOptimize large-scale workloads for performance, scalability, latency, and GCP cost.\nDefine reusable engineering standards for testing, versioning, CI/CD, and production readiness.\nLead technical design and code reviews and guide engineers on complex implementation decisions.\nIdentify systemic technical debt and drive improvements to shared platform capabilities.\nWork closely with data engineering, platform engineering, DevOps, architecture, governance, and product teams.\nTake technical ownership from solution design through production deployment and operational stability.\nRequirements:\n6+ years of hands-on experience designing and building enterprise-scale data platforms and data products.\nStrong production experience with Google Cloud Platform (GCP).\nDeep hands-on experience with BigQuery, including data modeling, partitioning, clustering, query optimization, and cost optimization.\nAdvanced SQL skills for complex transformation and analytical workloads.\nStrong programming experience with Python, including modular development, testing, and automation.\nStrong experience with Dataform and/or dbt.\nHands-on experience with Cloud Composer / Apache Airflow and complex DAG/workflow design.\nHands-on experience with Google Cloud Dataflow / Apache Beam.\nExperience with Dataproc and Spark / PySpark for distributed processing.\nExperience with Apache Iceberg or modern lakehouse table formats.\nStrong understanding of batch, incremental, idempotent, and streaming processing patterns.\nExperience designing reusable data-processing frameworks rather than only individual pipelines.\nExperience with metadata-driven and configuration-driven processing.\nStrong data-modelling skills, including dimensional, normalized, and denormalized models.\nExperience defining and implementing data contracts and schema-management patterns.\nStrong understanding of data quality, metadata, lineage, and observability.\nExperience with Git, automated testing, and CI/CD for data workloads.\nExperience designing solutions for reliability, recoverability, and production operations.\nAbility to independently make architectural decisions and communicate technical trade-offs.\nTechnical Skills:\nCloud and Storage: Google Cloud Platform, BigQuery, Google Cloud Storage, Apache Iceberg.\nTransformation and Orchestration: Advanced SQL, Dataform/dbt, Cloud Composer/Apache Airflow.\nDistributed and Streaming Processing: Dataflow, Apache Beam, Dataproc, Spark / PySpark.\nProgramming and Engineering: Python, Git, CI/CD, automated testing, monitoring, and observability.\nData Platform Capabilities: Batch and incremental processing, streaming and event processing, data modelling, data contracts and schema management, metadata-driven processing, configuration-driven processing, data quality and reconciliation, metadata and lineage, performance and cost optimisation, Reusable platform frameworks.\nGood to Have:\nPractical experience with data product/data mesh principles.\nExperience developing self-service or internal data-platform capabilities.\nExperience with change data capture and event-driven architectures.\nExposure to semantic and metric modelling.\nExperience with Terraform / Infrastructure as Code.\nExperience working with multi-domain or multi-market enterprise data platforms.\nStrong Interpersonal Skills:\nStrong technical ownership and ability to drive complex initiatives from concept to production.\nAbility to lead technical discussions and communicate architectural decisions clearly.\nStrong problem-solving and production troubleshooting skills.\nAbility to mentor engineers and improve engineering practices across a team.\nComfortable collaborating with engineering, architecture, product, and business stakeholders.\nAbility to work effectively within distributed and multicultural teams.","description_format":"text","description_chars":5301,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Digital Goods"],"lifecycle":[{"event":"open","at":"2026-08-29T01:43:24Z"}],"visa":[],"liveness":{"score":11,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.587,"p_room":0.45,"age_days":53,"expected_fill_days":27,"reasons":["seen:53","velocity","win:tail"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/deutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform","json_url":"https://alion.io/job/deutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform.json","meta":{"generated_at":"2026-10-21T09:31:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13450,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":409},"rest":"https://alion.io/mcp/rest/get_company?id=409"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdeutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdeutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdeutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/deutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdeutsche-telekom-digital-labs-senior-data-engineer-gcp-data-platform"}]}