{"id":2565761,"url":"https://alion.io/job/infosys-gcp-data-engineer-2","title":"GCP Data Engineer","company":{"id":223,"name":"Infosys","domain":"infosys.com","url":"https://alion.io/company/infosys","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"A","score":95,"open_postings":245,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":93,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":18500,"max_usd":49000,"period":"year","method":"role_country_seniority_unknown","sample_n":141},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Apache Kafka","optional":false},{"name":"BigQuery","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"GCP","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Google BigQuery","optional":false},{"name":"IAM","optional":false},{"name":"Jenkins","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-08T10:16:58Z","employer_posted_date":"2026-10-14","last_verified_at":"2026-10-16T18:14:00Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":8},"description":"Strong hands-on GCP Data Engineering experience across scalable cloud data platforms.\nExpertise in Google Cloud Storage, BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer, Cloud Functions, Cloud Monitoring, IAM and Secret Manager.\nStrong experience in batch and real-time streaming using Pub/Sub, Dataflow / Apache Beam, Spark Structured Streaming or Kafka.\nHands-on coding proficiency in Python, PySpark and SQL, including debugging and performance optimization.\nExperience building high-volume, low-latency ingestion and transformation pipelines with retry, idempotency, deduplication and dead-letter handling.\nStrong experience in Databricks, Delta Lake, Structured Streaming, Auto Loader and Spark performance tuning.\nExperience handling TB/PB-scale datasets, partitioning, clustering, file compaction, schema evolution and data lifecycle management.\nStrong understanding of Data Lake, Lakehouse and modern cloud data-platform architectures.\nPractical data-modeling experience for analytics, reporting and downstream consumption.\nExperience implementing CI/CD using Cloud Build, GitHub Actions, Jenkins or equivalent, with Terraform for Infrastructure as Code.\nStrong troubleshooting, observability, production support and cloud cost-optimization skills.\nExcellent client communication, stakeholder management and problem-solving skills.\nResponsibilities\nResponsibilities and JD in brief along with additional criteria to be considered:\nDesign and develop scalable GCP Data Engineering solutions and cloud-native data platforms.\nBuild batch and real-time pipelines using BigQuery, Cloud Storage, Dataflow, Pub/Sub, Dataproc, Python, PySpark and Databricks.\nDevelop and optimize Databricks, Delta Lake, Spark and Structured Streaming workloads for large-scale processing.\nImplement high-throughput streaming solutions using Pub/Sub and Dataflow, including windowing, watermarking, late-arriving data, duplicate handling and dead-letter queues.\nHandle high-volume TB/PB-scale data with focus on performance, scalability, reliability and cost optimization.\nDevelop complex SQL transformations, data models and analytics-ready BigQuery datasets using partitioning and clustering.\nOrchestrate pipelines using Cloud Composer / Airflow and implement CI/CD and Terraform-based Infrastructure as Code.\nEnsure data quality, governance, security, monitoring, alerting and production support.\nCollaborate with architects, stakeholders and cross-functional teams in an Agile delivery model.\nTroubleshoot and optimize end-to-end GCP, Databricks and streaming data pipelines.\nTechnical requirements\n1. GCP BigQuery, Cloud Storage, Dataflow, Pub/Sub, Dataproc, batch and real-time streaming, Databricks , Pyspark\n2. Python, strong SQL\nDatabricks with Delta Lake and Structured Streaming\nResponsibilities and JD in brief along with additional criteria to be considered:\nDesign and develop scalable GCP Data Engineering solutions and cloud-native data platforms.\nBuild batch and real-time pipelines using BigQuery, Cloud Storage, Dataflow, Pub/Sub, Dataproc, Python, PySpark and Databricks.\nDevelop and optimize Databricks, Delta Lake, Spark and Structured Streaming workloads for large-scale processing.\nImplement high-throughput streaming solutions using Pub/Sub and Dataflow, including windowing, watermarking, late-arriving data, duplicate handling and dead-letter queues.\nHandle high-volume TB/PB-scale data with focus on performance, scalability, reliability and cost optimization.\nDevelop complex SQL transformations, data models and analytics-ready BigQuery datasets using partitioning and clustering.\nOrchestrate pipelines using Cloud Composer / Airflow and implement CI/CD and Terraform-based Infrastructure as Code.\nEnsure data quality, governance, security, monitoring, alerting and production support.\nCollaborate with architects, stakeholders and cross-functional teams in an Agile delivery model.\nTroubleshoot and optimize end-to-end GCP, Databricks and streaming data pipelines.\nAdditional responsibilities\nInfosys is a global leader in next-generation digital services and consulting. Within the Data & Analytics unit, you will work on cutting-edge data engineering and analytics initiatives for global clients across industries. The role offers opportunities to work with cloud-native data platforms, modern analytics ecosystems, AI-driven solutions, and large-scale enterprise data modernization programs. Employees benefit from continuous learning programs, certifications, and career growth opportunities within Infosys' data and analytics practice\nPreferred skills\nTechnology->Cloud Platform->GCP Database\nEducation\nMaster Of Comp. Applications,Master Of Technology,Bachelor Of Science,Bachelor of Engineering,Bachelor Of Technology","description_format":"text","description_chars":4744,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Growth opportunities"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams"],"lifecycle":[{"event":"open","at":"2026-10-14T21:55:36Z"}],"visa":[],"liveness":{"score":99,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.993,"p_room":1,"age_days":7,"expected_fill_days":93,"reasons":["conf:1","wave","velocity","win:early","comp:brand"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/infosys-gcp-data-engineer-2","json_url":"https://alion.io/job/infosys-gcp-data-engineer-2.json","meta":{"generated_at":"2026-10-16T19:39:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5372,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":223},"rest":"https://alion.io/mcp/rest/get_company?id=223"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Finfosys-gcp-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Finfosys-gcp-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Finfosys-gcp-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/infosys-gcp-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Finfosys-gcp-data-engineer-2"}]}