2,426,328open jobs
149,975companies
297,570added this week
Browse all
Location
In office (Bengaluru)
Seniority
Senior
Visa
Sponsors visas in Ireland; no register of this country names it

Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 20, 2026.

Overview
Company
Impact
Profile match
HCLTech is an Indian information technology services and consulting company headquartered in Noida, Uttar Pradesh. Its roots lie in HCL, founded in 1976 by Shiv Nadar and partners, and the IT services business was set up as a separate company in 1991. It provides application development and maintenance, infrastructure and cloud services, cybersecurity, engineering and R&D services, and sells its own software products through HCLSoftware. The company employs more than 200,000 people in some 60 countries and is listed on the Indian stock exchanges.

Job Summary

The Databricks Developer will design, develop, test, and optimize scalable data-processing solutions using Apache Spark, PySpark, Delta Lake, and the Databricks platform. The role requires practical experience in reliable batch and change-data-capture pipelines, cloud integration, workload troubleshooting, and storage and processing optimization.

Key Responsibilities

  • Design, build, and maintain scalable Spark and PySpark data pipelines.
  • Develop Delta Lake solutions with effective schema handling, data quality controls, and read/write patterns.
  • Implement batch and CDC pipelines for incremental processing.
  • Optimize Spark jobs, storage layouts, and pipeline execution for performance, reliability, and cost.
  • Develop Databricks notebooks, workflows, jobs, and reusable components.
  • Integrate Databricks workloads with AWS services such as S3, EC2, ECS, and DynamoDB.
  • Troubleshoot pipeline failures, data-quality issues, performance bottlenecks, and production incidents.
  • Apply modular development, version control, testing, code review, deployment automation, and documentation practices.
  • Use REST APIs and platform automation where required.

Skill Requirements

  • Apache Spark knowledge from core concepts through distributed processing patterns.
  • Production-grade Python and PySpark development.
  • Practical Delta Lake and Delta table experience.
  • Storage, file-layout, Spark execution, and pipeline optimization.
  • Databricks notebooks, jobs, workflows, compute, and development practices.
  • Strong in Python data structures and algorithms.
  • AWS data-engineering services, particularly S3, with familiarity with EC2, ECS, and DynamoDB.
  • CDC and incremental data-processing solutions.
  • REST APIs for integration and automation.
  • Ability to develop solutions using Databricks Apps when required.

Other Requirements

Good-to-Have Qualifications

  • Spark Structured Streaming fundamentals.
  • Exposure to Mosaic AI capabilities.
  • Relevant Databricks certification or preparation toward certification.

Expected Developer Profile

The preferred candidate is a hands-on developer who can translate requirements into maintainable Databricks solutions. The strongest emphasis is on Spark, PySpark, Delta Lake, pipeline and storage optimization, AWS integration, and CDC.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,426,328 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Sales
Similar stack
Same company
Bengaluru
In office · Chennai
Java
Java
Spring Boot
Databases
Apache Kafka
Google Bigtable
DevOps
GCP
Docker
Kubernetes
Apply
In office · 10+ years exp · Bengaluru
Java
SQL
Java
Spring Boot
Databases
Oracle
DevOps
CI/CD
Management
Oracle ERP
Marketing
Salesforce
Apply
In office · 8+ years exp · Bengaluru
JavaScript
TypeScript
C#
C#
ASP.NET Core
Entity Framework Core
AI/ML
Embeddings
Function Calling
AI Agents
Semantic Kernel
LLM
RAG
OpenAI
Frontend
Angular
React.js
DevOps
Rest API
Azure
CI/CD
Docker
Cybersecurity
Microsoft Entra ID
Apply
In office · Full-Time · 3+ years exp · Mumbai
Apply
In office · Noida
DevOps
Terraform
Ansible
Azure
HAProxy
AWS
Nginx
DNS
Cybersecurity
Wireshark
Tcpdump
Management
ITIL
Apply
In office · Full-Time · 5+ years exp · Bachelor's Degree · Bengaluru
Apply
In office · Full-Time · Bengaluru
Python
SQL
Python
pySpark
Databases
Apache Kafka
AI/ML
Hadoop
Spark
Airflow
dbt
AI Agents
LLM
Machine Learning
DevOps
Terraform
AWS
Amazon S3
Analytics
ETL/ELT
AWS Glue
Apply
In office · Full-Time · Bengaluru
AI/ML
Copilot
AWS Bedrock
Gemini
OpenAI
Copilot Studio
DevOps
Azure
AWS
Linux
Wi-Fi
Cybersecurity
CyberArk
Microsoft Entra ID
Management
ServiceNow
Agile
Apply
In office · Full-Time · Bengaluru
AI/ML
Copilot
AWS Bedrock
Gemini
LLM
OpenAI
Copilot Studio
DevOps
Azure
AWS
IAM
Linux
Wi-Fi
Cybersecurity
CyberArk
Microsoft Entra ID
Management
ServiceNow
Agile
Apply
In office · Full-Time · Bengaluru · Gurgaon
Python
AI/ML
AI Agents
LLM Guardrails
Machine Learning
DevOps
CI/CD
AWS
TeamCity
Management
Agile
Scrum
Apply
See all jobs
This is one of many
2,426,328 more open roles from verified company boards, updated every day.