{"id":4618519,"url":"https://alion.io/job/symphoni-hr-ms-azure-data-architect","title":"MS Azure Data Architect","company":{"id":3800108,"name":"Symphoni HR","domain":"symphonihr.com","url":"https://alion.io/company/symphoni-hr","size_band":"201-500","is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"A","score":93,"open_postings":46,"ghost_share":0,"stale_share":0,"repost_share":0.435,"time_to_fill_p50_days":45,"computed_at":"2026-11-19T09:08:57Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"IAM","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Vault","optional":false}],"status":"live","first_seen_at":"2026-11-19T16:54:13Z","employer_posted_date":"2026-11-19","last_verified_at":"2026-11-19T16:54:43Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"We are migrating a large enterprise data platform from AWS to Azure, and the organisation is looking for a hands-on Data Architect to own the architecture of all ETL workloads moving to Azure Databricks. The role covers migration strategy, Lakehouse design, governance with Unity Catalog and integration with MS Fabric. You will combine deep architectural ownership with active engineering and technical leadership of the data engineering team.\nOur client is a leading global computer software company with a large-scale enterprise data and analytics practice. They are known for delivering sophisticated data transformation programmes to large organisations across multiple industries. The culture emphasises technical excellence, ownership and continuous innovation.\nResponsibilities\nDefine and execute the migration of Databricks workloads from AWS to Azure, including refactoring and re-architecting notebooks, jobs and Delta tables.\nDesign Lakehouse architecture using Delta Lake, Unity Catalog and Databricks Workflows, and define best practices for cluster configuration, autoscaling and cost optimisation.\nArchitect complex ETL pipelines using PySpark, Spark SQL and Delta Live Tables, ensuring data quality, error handling and performance.\nImplement Unity Catalog for fine-grained access control, lineage and auditing, ensuring compliance with enterprise security standards.\nDefine how Databricks Delta tables will be exposed to MS Fabric via OneLake shortcuts, Delta sharing or data writes to a Fabric Lakehouse.\nImplement enterprise-grade security including RBAC, row- and column-level security, Azure Key Vault integration and encryption at rest and in transit.\nMentor data engineers, conduct code reviews and act as the Databricks technical authority for the team.\nDesign and govern Azure data services integration, including Azure Data Factory, ADLS, Event Hubs, IoT Hubs and Azure Stream Analytics.\nRequirements\n10+ years of experience in Big Data engineering, with 5+ years specifically in Azure Databricks.\nExpert knowledge of Spark internals, Delta Lake and Unity Catalog.\nProven track record of migrating Databricks workloads from AWS to Azure.\nDeep hands-on experience building ETL with PySpark, Spark SQL and Delta Live Tables.\nHands-on experience with Azure Data Factory, ADLS, Azure Event Hubs, IoT Hubs or Azure Stream Analytics.\nStrong understanding of Azure networking (VNETs, Private Endpoints), IAM and cost management.\nProficiency in Python, PySpark and SQL.\nPreferred: Databricks Certified Data Engineer Professional or Databricks Architect certification.\nSkills\nAzure Databricks, PySpark, Spark SQL, Delta Lake, Unity Catalog, Delta Live Tables, Azure Data Factory, Python, SQL, ADLS, Azure Event Hubs, IoT Hubs, Azure Stream Analytics, Azure Key Vault, Databricks Workflows, MS Fabric","description_format":"text","description_chars":2816,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-19T16:54:13Z"}],"visa":[],"liveness":{"score":52,"band":"ok","label":"Likely open","p_open":1,"p_active":0.516,"p_room":1,"age_days":0,"expected_fill_days":45,"reasons":["conf:1","agency","win:early","comp:brand"],"computed_at":"2026-11-19T17:57:46Z"},"pay":null,"html_url":"https://alion.io/job/symphoni-hr-ms-azure-data-architect","json_url":"https://alion.io/job/symphoni-hr-ms-azure-data-architect.json","meta":{"generated_at":"2026-11-19T17:57:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29952,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800108},"rest":"https://alion.io/mcp/rest/get_company?id=3800108"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsymphoni-hr-ms-azure-data-architect"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsymphoni-hr-ms-azure-data-architect"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsymphoni-hr-ms-azure-data-architect"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/symphoni-hr-ms-azure-data-architect\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsymphoni-hr-ms-azure-data-architect"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4618519}},{"tool":"search_jobs","arguments":{"company":"symphonihr.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4618519},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}