Senior Administrator - Python

HCLTech • IT Consulting & Digital Transformation • IT Outsourcing & Dedicated Teams • Python • SQL • ETL/ELT • 3 days ago
Smart Apply
Similar jobs
1,338,985open jobs
78,444companies
206,994added this week
Browse all
Location
In office
Seniority
Senior · 8+ years exp

Confirmed on the employer's own hiring board on Oct 8, 2026. First seen by Alion on Oct 5, 2026.

Overview
Company
Impact
Profile match

HCLTech

HCLTech is a major Indian multinational information technology (IT) services and consulting company headquartered in Noida, Uttar Pradesh. Spun off from the original HCL Group in 1991, it ranks as one of India's largest technology companies alongside firms like TCS, Infosys, and Wipro.
hcltech.com • HQ: Noida, India • Systems Integrators • IT Consulting & Digital Transformation • IT Outsourcing & Dedicated Teams • 5000+ employees • Est. 1976
Tech stack of HCLTech

Job Summary

Python & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development

  • Design, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks
  • Build and optimize Spark jobs for large scale data processing
  • Develop reusable and modular Python code following best practices
  • Implement data transformations, aggregations, and validations Databricks Platform
  • Create and manage Databricks notebooks, jobs, and workflows
  • Optimize Spark performance (partitioning, caching, joins, memory tuning)
  • Work with Delta Lake (Delta tables, ACID transactions, schema evolution)
  • Manage Databricks clusters and job scheduling Data Integration
  • Ingest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)
  • Ensure data quality, reliability, and consistency Cloud & DevOps
  • Work with Azure / AWS / GCP (based on client environment)
  • Integrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)
  • Use Git for version control and collaborative development Collaboration & Client Interaction
  • Collaborate with business analysts and data scientists to understand requirements
  • Participate in sprint ceremonies (planning, review, retrospectives)
  • Support client demos, sprint reviews, and technical discussions
  • Troubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills
  • Strong hands on experience with Python
  • Solid experience with Databricks and Apache Spark (PySpark)
  • Good understanding of data warehousing concepts
  • Experience with Delta Lake
  • Strong SQL skills
  • Experience working with large datasets and distributed systems Cloud & Tools
  • Experience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)
  • Experience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills
  • Strong problem solving and analytical skills
  • Good communication and documentation skills
  • Experience working in Agile/Scrum delivery models
  • Ability to work in client facing environments ________________________________________ Good to Have
  • Experience with streaming frameworks (Kafka, Spark Structured Streaming)
  • Familiarity with data governance, security, and access controls
  • Exposure to machine learning workflows on Databricks
  • Databricks or cloud certifications Experience
  • 8+ years of overall experience in data engineering
  • 5+ years of hands on Databricks and Python/PySpark experience

Key Responsibilities

Python & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development

  • Design, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks
  • Build and optimize Spark jobs for large scale data processing
  • Develop reusable and modular Python code following best practices
  • Implement data transformations, aggregations, and validations Databricks Platform
  • Create and manage Databricks notebooks, jobs, and workflows
  • Optimize Spark performance (partitioning, caching, joins, memory tuning)
  • Work with Delta Lake (Delta tables, ACID transactions, schema evolution)
  • Manage Databricks clusters and job scheduling Data Integration
  • Ingest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)
  • Ensure data quality, reliability, and consistency Cloud & DevOps
  • Work with Azure / AWS / GCP (based on client environment)
  • Integrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)
  • Use Git for version control and collaborative development Collaboration & Client Interaction
  • Collaborate with business analysts and data scientists to understand requirements
  • Participate in sprint ceremonies (planning, review, retrospectives)
  • Support client demos, sprint reviews, and technical discussions
  • Troubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills
  • Strong hands on experience with Python
  • Solid experience with Databricks and Apache Spark (PySpark)
  • Good understanding of data warehousing concepts
  • Experience with Delta Lake
  • Strong SQL skills
  • Experience working with large datasets and distributed systems Cloud & Tools
  • Experience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)
  • Experience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills
  • Strong problem solving and analytical skills
  • Good communication and documentation skills
  • Experience working in Agile/Scrum delivery models
  • Ability to work in client facing environments Good to Have
  • Experience with streaming frameworks (Kafka, Spark Structured Streaming)
  • Familiarity with data governance, security, and access controls
  • Exposure to machine learning workflows on Databricks
  • Databricks or cloud certifications Experience
  • 8+ years of overall experience in data engineering
  • 5+ years of hands on Databricks and Python/PySpark experience

Skill Requirements

Python & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. ________________________________________ Key Responsibilities Data Engineering & Development

  • Design, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks
  • Build and optimize Spark jobs for large scale data processing
  • Develop reusable and modular Python code following best practices
  • Implement data transformations, aggregations, and validations Databricks Platform
  • Create and manage Databricks notebooks, jobs, and workflows
  • Optimize Spark performance (partitioning, caching, joins, memory tuning)
  • Work with Delta Lake (Delta tables, ACID transactions, schema evolution)
  • Manage Databricks clusters and job scheduling Data Integration
  • Ingest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)
  • Ensure data quality, reliability, and consistency Cloud & DevOps
  • Work with Azure / AWS / GCP (based on client environment)
  • Integrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)
  • Use Git for version control and collaborative development Collaboration & Client Interaction
  • Collaborate with business analysts and data scientists to understand requirements
  • Participate in sprint ceremonies (planning, review, retrospectives)
  • Support client demos, sprint reviews, and technical discussions
  • Troubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills
  • Strong hands on experience with Python
  • Solid experience with Databricks and Apache Spark (PySpark)
  • Good understanding of data warehousing concepts
  • Experience with Delta Lake
  • Strong SQL skills
  • Experience working with large datasets and distributed systems Cloud & Tools
  • Experience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)
  • Experience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills
  • Strong problem solving and analytical skills
  • Good communication and documentation skills
  • Experience working in Agile/Scrum delivery models
  • Ability to work in client facing environments Good to Have
  • Experience with streaming frameworks (Kafka, Spark Structured Streaming)
  • Familiarity with data governance, security, and access controls
  • Exposure to machine learning workflows on Databricks
  • Databricks or cloud certifications Experience
  • 8+ years of overall experience in data engineering
  • 5+ years of hands on Databricks and Python/PySpark experience

Other Requirements

Python & Databricks Developer Role Overview We are looking for a skilled Python and Databricks Developer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks platform. The role involves working closely with data engineers, data scientists, and client stakeholders to build reliable ETL pipelines and support advanced analytics use cases. Key Responsibilities Data Engineering & Development

  • Design, develop, and maintain ETL/ELT pipelines using Python (PySpark) and Databricks
  • Build and optimize Spark jobs for large scale data processing
  • Develop reusable and modular Python code following best practices
  • Implement data transformations, aggregations, and validations Databricks Platform
  • Create and manage Databricks notebooks, jobs, and workflows
  • Optimize Spark performance (partitioning, caching, joins, memory tuning)
  • Work with Delta Lake (Delta tables, ACID transactions, schema evolution)
  • Manage Databricks clusters and job scheduling Data Integration
  • Ingest data from multiple sources: o RDBMS (Oracle, SQL Server, MySQL, PostgreSQL) o Cloud storage (ADLS, S3, Blob Storage) o APIs and streaming sources (Kafka/Event Hubs - preferred)
  • Ensure data quality, reliability, and consistency Cloud & DevOps
  • Work with Azure / AWS / GCP (based on client environment)
  • Integrate pipelines with CI/CD tools (Azure DevOps, GitHub, GitLab)
  • Use Git for version control and collaborative development Collaboration & Client Interaction
  • Collaborate with business analysts and data scientists to understand requirements
  • Participate in sprint ceremonies (planning, review, retrospectives)
  • Support client demos, sprint reviews, and technical discussions
  • Troubleshoot production issues and perform root cause analysis Required Skills & Qualifications Technical Skills
  • Strong hands on experience with Python
  • Solid experience with Databricks and Apache Spark (PySpark)
  • Good understanding of data warehousing concepts
  • Experience with Delta Lake
  • Strong SQL skills
  • Experience working with large datasets and distributed systems Cloud & Tools
  • Experience with at least one cloud platform: o Azure (ADF, ADLS, Azure Databricks) - preferred o or AWS (S3, EMR, Glue)
  • Experience with CI/CD, Git, and Agile tooling (JIRA, Azure Boards) Soft Skills
  • Strong problem solving and analytical skills
  • Good communication and documentation skills
  • Experience working in Agile/Scrum delivery models
  • Ability to work in client facing environments Good to Have
  • Experience with streaming frameworks (Kafka, Spark Structured Streaming)
  • Familiarity with data governance, security, and access controls
  • Exposure to machine learning workflows on Databricks
  • Databricks or cloud certifications Experience
  • 8+ years of overall experience in data engineering
  • 5+ years of hands on Databricks and Python/PySpark experience
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,338,985 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
In your city
$191k – $214k per year • In office • Full-Time • Bachelor's Degree
Python
Java
Python
pySpark
Databases
ElasticSearch
AI/ML
Spark
AWS Bedrock
OpenAI
Hugging Face
Amazon SageMaker
DevOps
Git
AWS
Kubernetes
Amazon EKS
GitLab
Management
Confluence
Jira
Agile
Scrum
Kanban
Apply
In office • Tokyo
Python
JavaScript
PHP
TypeScript
Ruby
Node JS
PHP
Laravel
Node JS
Nest.JS
Fastify
Frontend
Vue.js
Nuxt.js
Next.js
React.js
styled-components
Remix
DevOps
Terraform
GCP
Datadog
Azure
AWS
GitHub
Windows
Design
Figma
Management
Slack
QA
Jest
Apply
In office • Full-Time • 3+ years exp • Hwaseong
JavaScript
TypeScript
SQL
Node JS
Node JS
Nest.JS
Databases
PostgreSQL
DevOps
Rest API
Git
AWS
Docker
Kubernetes
Amazon EKS
Management
Confluence
Jira
Microsoft Teams
Apply
≈ $65k – $180k per year (Estimated) • In office • Full-Time • 5+ years exp • Hwaseong
Rust
C++
Databases
PostgreSQL
SQLite
DevOps
Rest API
Git
AWS
Docker
Kubernetes
Amazon EKS
Linux
Windows
IoT
MQTT
Management
Confluence
Jira
Microsoft Teams
Apply
$264k – $380k per year • In office • Full-Time • 15+ years exp • Menlo Park
Databases
Snowflake
AI/ML
AI Agents
DevOps
GCP
OpenShift
Azure
Kubernetes
Apply
≈ $23k – $43k per year (Estimated) • Hybrid • 3+ years exp • Moscow
Python
SQL
Databases
PostgreSQL
ClickHouse
Apache Kafka
OpenSearch
AI/ML
dbt
LLM
DevOps
Terraform
Ansible
CI/CD
Kubernetes
Grafana
Analytics
ETL/ELT
Superset
Apply
up to $37k per year (net) • Hybrid • 3+ years exp • Bachelor's Degree • Moscow
Python
SQL
Databases
PostgreSQL
ClickHouse
Greenplum
Mobile
AppsFlyer SDK
Apply
≈ $23k – $41k per year (Estimated) • Remote (EAEU) • 2+ years exp • Moscow
Python
SQL
AI/ML
NumPy
Analytics
Seaborn
Matplotlib
Plotly
Metabase
Microsoft Excel
Apply
≈ $20k – $43k per year (Estimated) • In office • Full-Time • 5+ years exp • Bengaluru
Python
SQL
AI/ML
Claude
Prompt Engineering
AI Agents
Analytics
Power BI
Management
Power Automate
Power Apps
Apply
≈ $78k – $147k per year (Estimated) • Hybrid • 5+ years exp • Bachelor's Degree • Dublin
Python
SQL
Apex
Apex
MuleSoft
AI/ML
Claude
LLM
DevOps
GCP
Azure
AWS
Management
Intercom
Marketing
Salesforce
HubSpot
Marketo
Iterable
Apply
In office
Java
Java
Spring Boot
DevOps
CI/CD
Kubernetes
Management
Agile
Apply
In office
DevOps
VMWare
AWS
Windows
Cybersecurity
Active Directory
Apply
Hybrid • 7+ years exp
Python
SQL
Databases
Apache Kafka
Google BigQuery
BigQuery
AI/ML
Spark
Airflow
Scikit-learn
TensorFlow
PyTorch
RAG
Machine Learning
DevOps
GCP
CI/CD
Docker
Kubernetes
Analytics
ETL/ELT
Management
Agile
Scrum
Apply
In office
Python
PowerShell
Management
ITIL
Apply
In office
Python
DevOps
Terraform
Ansible
CI/CD
Git
Configuration Management
GitHub
Apply
See all jobs
This is one of many
1,338,985 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles