Technical Architect - Azure Databricks

We are seeking an experienced Technical Architect to design and lead modern, scalable data and analytics platforms on Microsoft Azure and Databricks. The role involves partnering with business and IT stakeholders to translate requirements into robust architecture blueprints, including HLDs and LLDs for data engineering and BI solutions. You will guide Medallion Architecture implementations, CI/CD and governance frameworks, and Microsoft Fabric and Power BI solutions, while leveraging Generative AI tools to accelerate delivery. This is a hybrid role based in Hyderabad / Bengaluru.

A leading global software company with a strong presence in computer software and digital solutions. The organization serves enterprise clients worldwide with scalable, cloud-driven technology and data platforms. Known for a collaborative, innovation-focused culture that values technical excellence and continuous learning.

Responsibilities

• Collaborate with business and IT teams to gather requirements and define solution designs for data and analytics initiatives.
• Prepare architecture blueprints for modern, scalable data and analytics platforms on Azure.
• Independently create High-Level Designs (HLDs) and Low-Level Designs (LLDs) covering data models, pipelines and reporting layers.
• Design and oversee ELT pipelines and PySpark notebooks on Databricks, including ML-based transformations.
• Implement Medallion Architecture (Bronze, Silver, Gold) to ensure data quality and efficient downstream analytics.
• Define and govern CI/CD pipelines, monitoring and governance frameworks for Azure data engineering solutions.
• Architect end-to-end solutions using Microsoft Fabric, including Lakehouses, OneLake, DirectLake and Dataflows Gen2.
• Lead data modernization initiatives leveraging Azure and Databricks.
• Apply Generative AI tools and Copilots to accelerate pipeline generation, code authoring and documentation.

Requirements

• At least 12 years of overall experience, with a minimum of 3 years in relevant architecture roles.
• 8+ years of hands-on experience with Azure Data Factory, Synapse Analytics and Azure Data Lake Storage.
• 4+ years of experience with Databricks, including PySpark development and ELT pipeline design.
• Strong expertise in Medallion Architecture and data quality frameworks.
• Experience with CI/CD pipelines, monitoring and governance for Azure-based data solutions.
• Hands-on experience with Microsoft Fabric (DirectLake, OneLake, Lakehouses, Dataflows Gen2, Notebooks); Fabric Copilots is a plus.
• Proficiency in Power BI (Pro and Premium), DAX, Power Query, M language, Dataflows and Incremental Refresh.
• Practical experience with Generative AI tools such as GitHub Copilot, Microsoft Fabric Copilot and M365 Copilot.
• Ability to work from a hybrid model and attend face-to-face meetings in Hyderabad / Bengaluru as required.

Skills

Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage, Databricks, PySpark, Medallion Architecture, CI/CD pipelines, Solution architecture (HLD/LLD), Microsoft Fabric (DirectLake, OneLake, Lakehouses, Dataflows Gen2, Notebooks), Fabric Copilots, Power BI (Pro, Premium, DAX, Power Query, M language, Dataflows, Incremental Refresh), Generative AI tools and Copilots (GitHub Copilot, Microsoft Fabric Copilot, M365 Copilot)