Senior Databricks Architect

Role Overview :

We are looking for an experienced Databricks Architect with 10+ years of experience in data engineering, cloud data platforms, enterprise data architecture, and Databricks.

The candidate will be responsible for designing scalable and secure data platforms using Databricks and related technologies, while working closely with data engineering, analytics, cloud, and business teams. This role is open to remote candidates.

Key Responsibilities :

- Design and implement enterprise-scale data platforms using Databricks.

- Define data architecture, data models, pipelines, and integration strategies.

- Design scalable and high-performance data processing solutions.

- Develop and review data engineering solutions using Databricks.

- Work with Delta Lake, Apache Spark, Databricks SQL, and related technologies.

- Design batch and real-time data processing pipelines.

- Integrate Databricks with cloud data services and enterprise applications.

- Define best practices for data governance, security, access control, and quality.

- Optimize Spark jobs, SQL queries, clusters, and data pipelines.

- Develop architecture standards and technical documentation.

- Collaborate with cloud architects, data engineers, analysts, and business stakeholders.

- Provide technical leadership and mentor data engineering teams.

- Troubleshoot complex data-platform and production issues.

- Support migration and modernization of legacy data platforms.

Required Technical Skills :

- 10+ years of experience in Data Engineering / Data Architecture.

- Strong hands-on experience with Databricks.

- Strong knowledge of Apache Spark / PySpark.

- Experience with Delta Lake and Databricks SQL.

- Strong SQL and Python skills.

- Experience with cloud platforms - Azure / AWS / GCP.

- Experience designing enterprise data lakes / lakehouse architectures.

- Strong understanding of ETL/ELT pipelines.

- Experience with data integration and orchestration tools.

- Knowledge of data governance, security, lineage, and data quality.

- Experience with CI/CD and DevOps practices.

- Strong understanding of distributed computing and scalable architectures.

Preferred Skills :

- Databricks certifications.

- Experience with Azure Databricks.

- Experience with data migration and modernization projects.

- Experience with enterprise-scale cloud data architecture.

- Knowledge of Unity Catalog and Databricks governance.

Skills

Azure Databricks, Data Engineering, Data Architect, Data Modeling, SQL, Apache Spark, Data Pipeline, Python, Azure, Data Warehousing