{"id":4258307,"url":"https://alion.io/job/vivantify-technology-solutions-senior-specialist-data-engineering","title":"Senior Specialist – Data Engineering","company":{"id":4478772,"name":"Vivantify Technology Solutions","domain":"vivantify.com","url":"https://alion.io/company/vivantify-technology-solutions-india-pvt-ltd","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Manatal","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Delta Lake","optional":false},{"name":"GCP","optional":false},{"name":"IAM","optional":false},{"name":"Java","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false}],"status":"live","first_seen_at":"2026-11-13T14:26:35Z","employer_posted_date":"2026-11-13","last_verified_at":"2026-11-13T14:26:35Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Location: Bengaluru\nExperience: 7-11 Years\nOpenings: 1\nEmployment Type: Permanent\nAbout the Role\nWe are looking for an experienced Senior Specialist - Data Engineering to design and establish scalable Data Lake/Lakehouse architectures for manufacturing and industrial data environments. The role involves building reliable data pipelines, implementing data governance and quality practices, enabling analytics and AI use cases, and assessing the security and compliance of ITAR-controlled data across the data landscape.\nJob Description\nThe position focuses on defining and implementing data lake architecture to support manufacturing analytics, reporting, and applicable AI/ML use cases. The candidate will work with machine, equipment, MES, test, and probe data, ensuring accurate lot-, wafer-, and die-level traceability.\nThe role also involves evaluating existing data environments, strengthening data quality, lineage, governance, and access controls, and ensuring appropriate handling of ITAR-controlled information. The candidate will collaborate with technical teams and senior stakeholders to document findings, recommend improvements, and deliver scalable data solutions.\nKey Responsibilities\nDesign and implement scalable Data Lake/Lakehouse architectures across cloud or on-premises environments.\nBuild and optimize data pipelines for manufacturing, machine, equipment, MES, test, and probe data.\nEstablish data quality, governance, lineage, cataloguing, and traceability practices.\nDevelop data processing solutions using SQL, Python, Scala/Java, and Spark.\nImplement data orchestration, streaming, CI/CD, and infrastructure automation.\nAssess ITAR-controlled data classification, segregation, access, and security controls.\nEnable analytics, reporting, and ML/AI use cases within manufacturing data environments.\nEngage with stakeholders, document assessments, and communicate technical recommendations.\nRequired Skills\nData Engineering: Strong experience in enterprise data engineering, particularly in manufacturing, semiconductor, or industrial environments.\nData Lake/Lakehouse: Azure Data Lake, Delta Lake, Iceberg, Parquet-based storage, or equivalent architectures.\nProgramming: SQL and Python or Scala/Java.\nDistributed Processing: Apache Spark.\nCloud Platforms: Azure, AWS, GCP, or on-premises data platforms.\nOrchestration & Streaming: Airflow, Azure Data Factory, Kafka, or Event Hubs.\nDevOps: CI/CD and Infrastructure as Code.\nData Governance: Data cataloguing, lineage, and data quality practices.\nAnalytics & BI: Power BI, Tableau, or Spotfire.\nAI/ML: Understanding of ML/AI data pipelines and manufacturing analytics use cases.\nSecurity & Compliance: ITAR/EAR export controls, IAM, RBAC/ABAC, encryption, network segmentation, and audit logging.\nMandatory Skills\nAzure Data Lake\n Azure DevOps\nCandidate Profile\nThe ideal candidate should have 8+ years of data engineering experience, preferably in manufacturing, semiconductor, or industrial environments. They should possess strong hands-on expertise in data lake architecture, distributed data processing, and cloud data platforms, along with an understanding of manufacturing data traceability, governance, and security compliance. Strong stakeholder management, assessment, and documentation skills are essential.\nBenefits Package\nCompetitive salary and benefits package.\nOpportunities for professional growth and development.\nA collaborative and inclusive work environment.\nThe opportunity to work on exciting and challenging projects with leading clients.","description_format":"text","description_chars":3540,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-13T14:26:35Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":36,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-13T15:51:01Z"},"pay":null,"html_url":"https://alion.io/job/vivantify-technology-solutions-senior-specialist-data-engineering","json_url":"https://alion.io/job/vivantify-technology-solutions-senior-specialist-data-engineering.json","meta":{"generated_at":"2026-11-13T15:51:01Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31772,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-14T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4478772},"rest":"https://alion.io/mcp/rest/get_company?id=4478772"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvivantify-technology-solutions-senior-specialist-data-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvivantify-technology-solutions-senior-specialist-data-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvivantify-technology-solutions-senior-specialist-data-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vivantify-technology-solutions-senior-specialist-data-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvivantify-technology-solutions-senior-specialist-data-engineering"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4258307}},{"tool":"search_jobs","arguments":{"company":"vivantify.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4258307},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}