Databricks Technical Lead
First seen by Alion on Sep 25, 2026.
Role : We are looking for an experienced Databricks Technical Lead to join our Data Engineering team in Bangalore (Whitefield).
Key Responsibilities :
- Lead the design, development, and implementation of scalable data engineering solutions using Databricks.
- Provide technical leadership to a team of data engineers, conduct code/design reviews, and ensure adherence to engineering best practices.
- Act as a key technical point of contact for client stakeholders and translate business requirements into technical data models and transformation logic.
- Ensure data quality, reliability, scalability, and performance across pipelines.
- Take end-to-end ownership of assigned data engineering initiatives from requirement clarification to production support.
Required Skills :
- Strong hands-on experience with Azure Databricks (Notebooks, Delta Lake, Jobs & Orchestration).
- Deep expertise in Apache Spark, PySpark & Spark SQL.
- Strong Python programming skills for data processing & automation.
- Strong SQL skills (complex queries, analytical functions & performance tuning).
- Experience with CI/CD & Git-based development.
- Expertise in Data Modeling & ETL/ELT pipeline design.
- Strong understanding of Distributed Systems & Big Data concepts.
Good to Have :
- Experience with Microsoft Fabric, Power BI, ADLS Gen2, and streaming technologies (Kafka/Event Hubs).
- Knowledge of data security, governance, and DevOps/IaC practices.
- Experience with semiconductor or manufacturing data platforms.
Skills
Azure Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, Data Modeling, ETL, Data Engineering, Data Management, Microsoft Fabric