2,396,451open jobs
149,541companies
292,251added this week
Browse all
Location
In office (Bengaluru)
Seniority
Architect · 10+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 19, 2026. First seen by Alion on Nov 19, 2026. Symphoni HR scores A on the Alion truth index.

Overview
Company
Impact
Profile match
Symphoni HR is an executive search and specialist recruitment firm headquartered in Malad West, Mumbai, handling board, CEO and CXO appointments alongside technology hiring, recruitment process outsourcing, project hiring and fractional leadership services. Established in 2003, it reports more than 100,000 candidates hired and over 5,000 C-suite and senior mandates for 300+ clients across practices such as global capability centres, financial services, technology, industrial and healthcare. The roles on its board are client vacancies, mostly in Mumbai, Bengaluru and Pune, for Java and C++ developers, data engineers, DevOps and GenAI engineers, business analysts and project managers.

We are migrating a large enterprise data platform from AWS to Azure, and the organisation is looking for a hands-on Data Architect to own the architecture of all ETL workloads moving to Azure Databricks. The role covers migration strategy, Lakehouse design, governance with Unity Catalog and integration with MS Fabric. You will combine deep architectural ownership with active engineering and technical leadership of the data engineering team.

Our client is a leading global computer software company with a large-scale enterprise data and analytics practice. They are known for delivering sophisticated data transformation programmes to large organisations across multiple industries. The culture emphasises technical excellence, ownership and continuous innovation.

Responsibilities

  • Define and execute the migration of Databricks workloads from AWS to Azure, including refactoring and re-architecting notebooks, jobs and Delta tables.
  • Design Lakehouse architecture using Delta Lake, Unity Catalog and Databricks Workflows, and define best practices for cluster configuration, autoscaling and cost optimisation.
  • Architect complex ETL pipelines using PySpark, Spark SQL and Delta Live Tables, ensuring data quality, error handling and performance.
  • Implement Unity Catalog for fine-grained access control, lineage and auditing, ensuring compliance with enterprise security standards.
  • Define how Databricks Delta tables will be exposed to MS Fabric via OneLake shortcuts, Delta sharing or data writes to a Fabric Lakehouse.
  • Implement enterprise-grade security including RBAC, row- and column-level security, Azure Key Vault integration and encryption at rest and in transit.
  • Mentor data engineers, conduct code reviews and act as the Databricks technical authority for the team.
  • Design and govern Azure data services integration, including Azure Data Factory, ADLS, Event Hubs, IoT Hubs and Azure Stream Analytics.

Requirements

  • 10+ years of experience in Big Data engineering, with 5+ years specifically in Azure Databricks.
  • Expert knowledge of Spark internals, Delta Lake and Unity Catalog.
  • Proven track record of migrating Databricks workloads from AWS to Azure.
  • Deep hands-on experience building ETL with PySpark, Spark SQL and Delta Live Tables.
  • Hands-on experience with Azure Data Factory, ADLS, Azure Event Hubs, IoT Hubs or Azure Stream Analytics.
  • Strong understanding of Azure networking (VNETs, Private Endpoints), IAM and cost management.
  • Proficiency in Python, PySpark and SQL.
  • Preferred: Databricks Certified Data Engineer Professional or Databricks Architect certification.

Skills

Azure Databricks, PySpark, Spark SQL, Delta Lake, Unity Catalog, Delta Live Tables, Azure Data Factory, Python, SQL, ADLS, Azure Event Hubs, IoT Hubs, Azure Stream Analytics, Azure Key Vault, Databricks Workflows, MS Fabric

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,396,451 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Bengaluru
In office · Full-Time · 8+ years exp · Noida
SQL
Databases
Db2
DevOps
Azure
AWS
Apply
Data Engineer 29 days ago
In office · Full-Time · 5+ years exp · Bachelor's Degree · Bengaluru
SQL
DevOps
Azure
AWS
Analytics
Tableau
Power BI
ETL/ELT
Apply
In office · Full-Time · 8+ years exp · Bachelor's Degree · Bengaluru · Hyderabad
SQL
Databases
MySQL
PostgreSQL
Oracle
MS SQL
Azure SQL Database
DevOps
GCP
AWS
Apply
Data Architect 2 hours ago
In office · Full-Time · 8+ years exp · Bachelor's Degree · Chennai
SQL
Databases
Snowflake
Databricks
Apache Kafka
AI/ML
Machine Learning
DevOps
Azure
AWS
Analytics
Power BI
Informatica
Dimensional Modeling
Collibra
Apply
In office · 5+ years exp · Bachelor's Degree · Coimbatore
SQL
Databases
Oracle
AI/ML
LangGraph
LangChain
AI Agents
OpenAI
Copilot Studio
DevOps
Azure
CI/CD
Git
AWS
Analytics
ETL/ELT
Collibra
Erwin
Management
ITIL
Apply
In office · Full-Time · Bengaluru
Python
SQL
Python
pySpark
Databases
Apache Kafka
AI/ML
Hadoop
Spark
Airflow
dbt
AI Agents
LLM
Machine Learning
DevOps
Terraform
AWS
Amazon S3
Analytics
ETL/ELT
AWS Glue
Apply
Senior Data Scientist 2 hours ago
In office · Full-Time · 7+ years exp · Master's Degree · Bengaluru
Python
SQL
AI/ML
Machine Learning
Apply
≈ $14k – $31k per year (Estimated) · Hybrid · Full-Time · 2+ years exp · Bengaluru
AI/ML
LLM
Apply
In office · Full-Time · 5+ years exp · Bachelor's Degree · Bengaluru
Apply
≈ $25k – $58k per year (Estimated) · In office · Full-Time · 15+ years exp · Master's Degree · Bengaluru
Python
Go
JavaScript
TypeScript
DevOps
CI/CD
AWS
Management
ServiceNow
Apply
See all jobs
This is one of many
2,396,451 more open roles from verified company boards, updated every day.