2,461,807open jobs
149,882companies
317,954added this week
Browse all
Salary
up to $27k per year
Location
Remote (India)
Seniority
Senior · 4+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 22, 2026. First seen by Alion on Sep 28, 2026.

Overview
Company
Impact
Profile match
Highly curated talent, available to join soon on permanent or contract roles. Write to [email protected].

Hiring for: A technology company delivering enterprise data engineering and analytics solutions, with a strong focus on modern cloud data platforms and Databricks.

Role: Senior Databricks Data Engineer - PySpark - Bangalore/ Pune

Positions: 10

Experience: 4 to 7 years

Location(s): Remote (Bangalore, Pune)

Type: On-site, Remote / Permanent

Salary: Up to INR 25 LPA

Notice Period: Immediate to 30 days

Must Have: Databricks Development, Pyspark, Python, SQL, Unity Catalogs,

Job Summary

We are seeking an experienced PySpark ETL Developer with 4+ years of experience in designing, developing, and optimizing enterprise ETL pipelines using PySpark. The ideal candidate should have strong expertise in Python, Apache Spark, Databricks, and Snowflake, along with hands-on experience in processing large-scale data and building scalable data engineering solutions. You will work closely with business stakeholders and cross-functional teams to develop high-performance data pipelines that support business intelligence and analytics initiatives.

Key Responsibilities

  • Design, develop, and maintain scalable ETL pipelines using PySpark and Spark SQL.
  • Collaborate with stakeholders to gather business requirements and translate them into efficient data engineering solutions.
  • Extract data from multiple sources, including databases, APIs, data lakes, files, and streaming platforms.
  • Transform, cleanse, and validate data using PySpark to ensure high data quality and consistency.
  • Develop and optimize Spark jobs for performance, scalability, and efficient resource utilization.
  • Build and maintain batch and streaming data pipelines to support real-time and near real-time processing.
  • Load transformed data into data lakes, data warehouses, and analytical platforms.
  • Implement robust error handling, logging, monitoring, and troubleshooting mechanisms for ETL workflows.
  • Document ETL processes, data lineage, transformation logic, and technical specifications.
  • Develop unit, integration, and performance tests to ensure reliable and accurate data processing.
  • Collaborate with cross-functional teams to deliver scalable, secure, and high-quality data solutions.

Required Skills

  • 4+ years of experience as a Data Engineer or ETL Developer.
  • Strong hands-on experience with PySpark, Apache Spark, Spark SQL, and Python.
  • Expertise in Databricks.
  • Strong understanding of ETL design, data transformation, and data integration.
  • Experience with Data Lakes, Data Warehouses, and Big Data technologies.
  • Knowledge of distributed computing, parallel processing, and data partitioning concepts.
  • Strong SQL skills with experience in performance tuning and query optimization.
  • Experience working with batch and streaming data processing.
  • Excellent analytical, debugging, and problem-solving skills.
  • Strong verbal and written communication skills.

Preferred Skills

  • Experience with cloud platforms such as AWS or Azure.
  • Knowledge of Hadoop ecosystem and modern data engineering technologies.
  • Experience with API integration and data ingestion from multiple data sources.
  • Familiarity with CI/CD pipelines and Agile development methodologies.
  • Exposure to enterprise-scale data engineering projects.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,461,807 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Bengaluru
Data Engineer 2 days ago
In office · Full-Time · 6+ years exp · Navi Mumbai
Python
SQL
Python
pySpark
Databases
Amazon Redshift
AI/ML
Hadoop
Spark
DevOps
AWS
Amazon EC2
Amazon S3
Analytics
ETL/ELT
Management
Agile
Apply
Remote (United States) · Full-Time · 10+ years exp · Bachelor's Degree · United States
Python
Python
pySpark
Databases
Azure SQL Database
Microsoft Fabric
AI/ML
Hadoop
Spark
DevOps
Azure
Apply
Senior Data Engineer 4 hours ago
Remote (United States) · Full-Time
SQL
Databases
PostgreSQL
Google BigQuery
Analytics
ETL/ELT
Apply
Remote (Canada) · Full-Time · Toronto
Databases
Snowflake
Databricks
Apache Kafka
Google BigQuery
AI/ML
dbt
NLP
Tokenization
Feature Store
Cybersecurity
HIPAA
MedTech
HL7
FHIR
Apply
In office · Full-Time · 15+ years exp · Bengaluru
Python
SQL
Python
pySpark
Databases
Databricks
Oracle
AI/ML
Spark
Apply
In office · 8+ years exp · Hyderabad
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
Teradata
AI/ML
Spark
DevOps
Azure
Analytics
Alteryx
Cognos
Apply
In office · 6+ years exp · Hyderabad
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
DevOps
Azure
Analytics
Cognos
Apply
In office · 11+ years exp · Bengaluru · Hyderabad · Pune
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Spark
DevOps
GCP
Azure
CI/CD
AWS
Management
Agile
Scrum
Apply
Knowledge Engineer 9 hours ago
In office · 3+ years exp · Gurgaon
Python
SQL
AI/ML
Embeddings
LLM
RAG
DevOps
GCP
Apply
In office · 8+ years exp · Bengaluru
Python
JavaScript
SQL
AI/ML
Prompt Engineering
Function Calling
AI Agents
LLM
RAG
Hallucination
Structured Outputs
DevOps
CI/CD
QA
JMeter
Gatling
k6
Apply
In office · Full-Time · 5+ years exp · Mumbai
DevOps
Rest API
Design
Figma
Management
Miro
Apply
up to $32k per year · Remote (worldwide) · Full-Time · 5+ years exp
Python
SQL
Python
pySpark
Databases
Snowflake
Databricks
AI/ML
Spark
Fine-tuning
TensorFlow
PyTorch
Tokenization
Self-Supervised Learning
Recommender Systems
Machine Learning
Apply
In office · Full-Time · 5+ years exp · Mumbai
Python
JavaScript
Node JS
AI/ML
LLM
Frontend
React.js
Apply
In office · Full-Time · 5+ years exp · Chennai
Python
JavaScript
TypeScript
Databases
PostgreSQL
Weaviate
pgvector
Pinecone
AI/ML
ElevenLabs
Fine-tuning
Embeddings
Prompt Engineering
Knowledge Distillation
Function Calling
AI Agents
NLP
LLM
RAG
Whisper
Hallucination
Reranking
OpenAI
Anthropic
Deepgram
Structured Outputs
LLM Evaluation
LLM Guardrails
Model Distillation
DevOps
Rest API
GCP
Azure
AWS
Cybersecurity
HIPAA
Analytics
A/B Testing
MedTech
FHIR
Apply
In office · 4+ years exp · Mumbai
JavaScript
TypeScript
Node JS
Node JS
Nest.JS
Databases
PostgreSQL
Redis
Apache Kafka
DevOps
Rest API
AWS
Apply
Interior Designer 1 day ago
In office · 2+ years exp · Bengaluru
Design
AutoCAD
Apply
In office · Internship · Bengaluru
Apply
In office · 1+ year exp · Bengaluru
Design
3ds Max
AutoCAD
Apply
In office · 4+ years exp · Bengaluru
Apply
In office · 5+ years exp · Bengaluru
Python
Go
JavaScript
PHP
Cybersecurity
Semgrep
OWASP Top 10
Threat Modeling
Apply
See all jobs
This is one of many
2,461,807 more open roles from verified company boards, updated every day.