{"id":4662151,"url":"https://alion.io/job/vivanti-consulting-senior-data-engineer-gcp","title":"Senior Data Engineer - GCP","company":{"id":3808099,"name":"Vivanti Consulting","domain":"vivanti.com","url":"https://alion.io/company/vivanti-consulting","size_band":"51-200","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Hadoop","optional":false},{"name":"Java","optional":false},{"name":"Pandas","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Scrum","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-20T05:43:29Z","employer_posted_date":null,"last_verified_at":"2026-11-20T05:43:29Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Senior Data Engineer - GCP\n\nYour Career, Accelerated\n\nYou've got the skills. The curiosity. The hunger to grow, try new things and make a real impact.\n\nWe're a growing global tech consultancy. Some of the world's biggest businesses turn to us to help bring their data, AI, cloud and digital solutions to life.\n\nWe're the home base for talented technologists who want more and are looking to take their career to the next level by having more learning, more variety, more support and more chances to do meaningful work.\n\nWhat You'll Get\n\nAt Vivanti, you're not just taking a job, you're investing in your growth. Here's a taste:\n\n- A platform for growth: Work across industries, clients and technologies that stretch your thinking and build your personal and professional skills.\n\n- Access global businesses: Work with some of the world's biggest brands.\n\n- IP, frameworks and accelerators: We share what we know.\n\n- All the shiny tech: Databricks, Snowflake, Azure, GCP, AWS.\n\n- Senior consultants who have your back: You'll always have a guide on your journey.\n\n- Serious learning support: Paid certs, weekly training, guilds, hackathons, mentoring and more.\n\n- Progress that's transparent: Annual reviews based on 360 degree feedback.\n\n- Kudos and rewards: We celebrate wins, reward impact and offer long-term incentives.\n\n- Real connection: From Friday socials to annual team building days.\n\nWhat We're Looking For\n\nWe are looking for an accomplished and highly motivated Senior GCP Data Engineer to design, build, and optimize our Google Cloud Platform data architecture and pipelines.\n\n- 6+ years of hands-on experience with Google Cloud Platform (GCP) data and analytics services.\n\n- Experience using SQL, python or other relevant technology.\n\n- Core Services: BigQuery (expert level), Cloud Dataflow (Apache Beam), Cloud Storage.\n\n- Processing: Dataproc (Apache Spark/Hadoop), Pub/Sub.\n\n- Orchestration: Cloud Composer (Apache Airflow).\n\n- Deep understanding of Data Warehousing, Data Lake concepts, and advanced data modeling techniques.\n\n- Experience with Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.\n\n- Strong knowledge of version control (Git), software development lifecycle, and Agile/Scrum methodologies.\n\nWhat You'll Do\n\n- Architect, design, and implement robust, scalable, and fault-tolerant data ingestion and ETL/ELT pipelines for batch and real-time processing on GCP.\n\n- Define and enforce data modeling standards for optimal performance in BigQuery.\n\n- Lead the technical design and deployment of Data Lakes and Data Warehouses using best-in-class GCP services.\n\n- Develop and maintain complex data pipelines using Python (Pandas, PySpark) and/or Scala/Java.\n\n- Write, optimize, and tune advanced SQL queries for efficiency and cost reduction.\n\n- Implement data orchestration and workflow management using Cloud Composer (Apache Airflow).\n\n- Ensure optimal performance, cost efficiency, and reliability of all data solutions.\n\n- Implement data governance and data quality frameworks.\n\n- Establish and enforce security best practices on GCP.\n\n- Drive DevOps principles: implement and maintain CI/CD pipelines for data solutions.\n\nPerks & Benefits\n\n- Vivanti Articulate - our public speaking & communication program.\n\n- Mentoring Program - with a Senior Support Lead.\n\n- 360 degree Progress Reviews.\n\n- Guilds & Weekly Training.\n\n- Paid Certifications.\n\n- Hackathons & Innovation Days.\n\n- Kudos & Recognition Programs.\n\n- Socials & Team Days.\n\nAbout Vivanti\n\nThe Data People Shaping Tomorrow. Vivanti was founded as a haven for talented technologists who want to make a real impact for their clients. Our mission is to transform businesses and to create a smarter, more connected world through the power of data and technology.\nSkills\nData Engineering, Google Cloud Platform, BigQuery, Python, Dataproc","description_format":"text","description_chars":3855,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Consulting & Integration","Analytics & BI Consulting"],"lifecycle":[{"event":"open","at":"2026-11-20T06:34:10Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":31,"reasons":["seen:1","win:early"],"computed_at":"2026-11-21T12:56:33Z"},"pay":null,"html_url":"https://alion.io/job/vivanti-consulting-senior-data-engineer-gcp","json_url":"https://alion.io/job/vivanti-consulting-senior-data-engineer-gcp.json","meta":{"generated_at":"2026-11-21T12:56:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21561,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3808099},"rest":"https://alion.io/mcp/rest/get_company?id=3808099"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvivanti-consulting-senior-data-engineer-gcp"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvivanti-consulting-senior-data-engineer-gcp"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvivanti-consulting-senior-data-engineer-gcp"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vivanti-consulting-senior-data-engineer-gcp\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvivanti-consulting-senior-data-engineer-gcp"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4662151}},{"tool":"search_jobs","arguments":{"company":"vivanti.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4662151},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}