Senior Azure Databricks Data Engineer

HCLTech is a global technology company, home to more than 227,000 people across 60 countries, delivering industry-leading capabilities centered around AI, digital, engineering, cloud and software, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology & Services, Semiconductor, Telecom and Media, Retail and CPG, Mobility and Public Services. Consolidated revenues as of 12 months ending March 2026 totaled $14.7B.

To learn how we can supercharge progress for you, visit

hcltech.com.

Overview of the Role

As a Senior Azure Databricks Data Engineer at HCLTech, you will play a pivotal role in designing, developing, and optimizing large-scale data platforms and modern data pipelines on Microsoft Azure. This position is critical for advancing our enterprise data analytics, reporting, and business intelligence initiatives. You will contribute to the creation of scalable, high-performance data solutions that empower strategic decision-making and drive business growth across global clients.

Detailed Responsibilities:

• Design, develop, and maintain robust data pipelines utilizing Azure Databricks and PySpark to handle complex enterprise data requirements.

• Build scalable ETL/ELT solutions tailored for large-scale, heterogeneous data ecosystems across multiple business domains.

• Analyze business requirements and translate them into effective and sustainable data engineering solutions.

• Develop and optimize data transformation frameworks and workflows, ensuring high performance and reliability.

• Conduct performance tuning, troubleshooting, and optimization of Databricks workloads and SQL queries to maximize efficiency.

• Architect and implement data ingestion, transformation, and integration processes across cloud and hybrid environments.

• Collaborate closely with solution architects, business analysts, and key stakeholders to deliver end-to-end data platform solutions.

• Implement and enforce best practices around data quality, governance, security, and operational excellence.

• Support CI/CD, DevOps, and cloud deployment activities to ensure streamlined and automated data delivery.

• Mentor junior engineers and contribute to technical leadership within the team.

Skill Requirements:

• 8-12 years of experience in Data Engineering and ETL Development.

• At least 7 years of hands-on experience with Azure Databricks.

• Strong proficiency in Python and PySpark frameworks/libraries.

• Minimum 7 years of advanced SQL experience, including query optimization and performance tuning.

• Minimum 7 years in designing and implementing complex ETL processes and data workflows.

• Deep understanding of data transformation frameworks and industry-standard patterns.

• Proven expertise in enterprise data ecosystems, including data storage, processing, visualization, and integration architectures.

• Experience managing and processing large-scale structured and unstructured datasets.

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.

Other Requirements:

• Expertise in Azure Data Factory (ADF) is a plus.

• Ability to read and analyze database execution plans.

• Experience with Azure DevOps and CI/CD cloud implementations.

• Familiarity with Configuration Management, Data Lake, Delta Lake, Synapse Analytics, and modern cloud data architectures.

• Azure certifications are highly preferred.

• Strong analytical, problem-solving, and communication skills.

• Experience in global delivery and customer-facing environments.

• Demonstrated ability to mentor junior engineers and drive technical excellence.

• Ownership mindset with a focus on quality and continuous improvement.

Career Development Opportunities

HCLTech is dedicated to nurturing talent and supporting career advancement.

As a Senior Azure Databricks Data Engineer, you will have access to:

• Global learning and development programs focused on next-generation technologies and leadership skills.

• Opportunities for promotion to Lead Data Engineer, Data Architect, or Solution Architect roles.

• Participation in industry conferences, certification programs, and specialized technical training.

• Involvement in high-impact projects with Fortune 500 clients and exposure to cutting-edge solutions.

• A culture that values innovation, encourages continuous improvement, and rewards high performance. Join HCLTech and advance your career in a dynamic, collaborative, and growth-oriented environment.

Benefit package:

• Life insurance

• Private medical care

• MultiSport Card

• Subsidy for glasses

• Subsidy to language courses

• Christmas and holiday bonuses