{"id":2576731,"url":"https://alion.io/job/neogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark","title":"Senior Data Engineer – GCP & Apache Spark","company":{"id":3798318,"name":"NeoGenCode Technologies Pvt Ltd","domain":"neogencode.com","url":"https://alion.io/company/neogencode-technologies-pvt-ltd","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":2000000,"max":3500000,"currency":"INR","period":"year","gross":true,"usd_annual":37058},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"BigQuery","optional":false},{"name":"CI/CD","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"pySpark","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Airflow","optional":true},{"name":"Apache Kafka","optional":true},{"name":"Git","optional":true},{"name":"Linux","optional":true},{"name":"Python","optional":true},{"name":"Unix","optional":true}],"status":"live","first_seen_at":"2026-10-14T07:46:47Z","employer_posted_date":null,"last_verified_at":"2026-10-14T07:46:47Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Job Title : Senior Data Engineer – GCP & Apache Spark\nJob Details :\nNumber of Positions : 3\nEmployment Type : Contract-to-Hire (C2H)\nExperience Required : 5 to 8 Years\nLocation : Manyata Tech Park, Bengaluru\nWork Mode : Hybrid – 3 Days in Office per Week\nPreferred Notice Period : Immediate to 15–20 Days\nProject Duration : Initially 6–8 months, with a strong possibility of extension for long-term projects\nRelocation : Candidates from outside Bengaluru can apply if they are willing to relocate.\n\nRole Overview :\nWe are looking for experienced Senior Data Engineers with strong expertise in Google Cloud Platform (GCP), Apache Spark, BigQuery, and SQL to design, develop, and maintain scalable data pipelines and distributed data processing solutions.\nThe ideal candidate should have hands-on experience with cloud-based data engineering, end-to-end pipeline architecture, system design, performance optimization, debugging, and CI/CD practices.\n\nMandatory skills :\nApache Spark (PySpark / Scala), SQL, GCP, BigQuery, GCP Dataproc, Data Pipelines, System Design, CI/CD, Debugging & Problem-Solving.\n\nKey Responsibilities :\nDesign, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and/or Scala.\nBuild and optimize batch and distributed data processing workflows on GCP.\nWork extensively with BigQuery for data transformation, validation, analytics, and query optimization.\nDevelop and maintain data workflows using GCP services, including Dataproc, BigQuery, and Cloud Storage.\nDesign end-to-end data pipeline architectures with a focus on scalability, reliability, and performance.\nWrite and optimize complex SQL queries for large-scale datasets.\nTroubleshoot and resolve data processing issues, pipeline failures, and performance bottlenecks.\nImplement CI/CD practices for data engineering workflows, testing, and deployments.\nMonitor pipeline performance and identify opportunities for continuous improvement.\nCollaborate with cross-functional teams to understand requirements and deliver reliable data solutions.\nParticipate in code reviews, testing, production deployments, and production support.\n\nMandatory Skills :\nStrong hands-on experience with Apache Spark, including PySpark and/or Scala.\nStrong SQL skills and experience working with large-scale datasets.\nHands-on experience with Google Cloud Platform (GCP).\nPractical experience with BigQuery and data warehousing concepts.\nWorking knowledge of GCP Dataproc.\nStrong understanding of data pipelines, end-to-end workflows, and system design.\nPractical experience with CI/CD and deployment processes.\nExcellent debugging, troubleshooting, and problem-solving skills.\n\nPreferred Skills :\nExperience with Apache Airflow, Google Cloud Composer, or similar orchestration tools.\nKnowledge of Kafka or other streaming and messaging technologies.\nProficiency in Python for data engineering and automation.\nExperience with Git-based development workflows.\nKnowledge of Linux/Unix environments and shell scripting.\nFamiliarity with monitoring, logging, data quality, and governance practices.\n\nRequired Qualifications :\n5 to 8 years of experience in Data Engineering, Big Data Engineering, or a related field.\nProven experience developing and maintaining scalable data pipelines.\nStrong understanding of distributed data processing and cloud-based data architecture.\nAbility to troubleshoot complex technical issues and optimize pipeline performance.\nStrong communication, collaboration, and ownership skills.\n\nInterview Process :\nRound 1 : AI-Based Interview\nCandidates must complete the AI interview as soon as possible after receiving the invitation.\nRound 2 : Virtual Interview Drive\nInterviews are planned for the upcoming drive; exact dates will be communicated separately.\nRound 3 : Online Client Interview\nShortlisted candidates will attend the online interview.\nCandidates must be available throughout the day on the scheduled interview date.\nSkills\nData engineering, Google Cloud Platform (GCP), Apache Spark, Google BigQuery, SQL, PySpark, Scala, GCP DataProc, Data Pipelines, Systems design, CI/CD, Debugging, Problem solving","description_format":"text","description_chars":4117,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development","AI Consulting & Integration","IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-10-15T00:22:00Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":23,"reasons":["seen:0","velocity","win:early"],"computed_at":"2026-10-15T05:46:00Z"},"pay":{"stated_usd_annual":37058,"is_top_pay":false},"html_url":"https://alion.io/job/neogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark","json_url":"https://alion.io/job/neogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark.json","meta":{"generated_at":"2026-10-15T11:38:19Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17888,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3798318},"rest":"https://alion.io/mcp/rest/get_company?id=3798318"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fneogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fneogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fneogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/neogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fneogencode-technologies-pvt-ltd-senior-data-engineer-gcp-apache-spark"}]}