2,363,809open jobs
147,929companies
288,109added this week
Browse all
Location
In office (Bengaluru)
Seniority
Senior · 7+ years exp

First seen by Alion on Nov 18, 2026.

Overview
Company
Impact
Profile match
What we do Industries Platforms Career About Us Contact Us About Us With over 15 years of delivering excellence, we are a trusted global talent and workforce solutions partner with a strong presence across the USA, India, UAE, and the Netherlands.

Role : Senior Data Engineer (7+ Years).

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Spark, Scala, Hive, and Kafka to join our team. The ideal candidate should have experience building and optimizing large-scale data pipelines, working with distributed data processing systems, and handling complex production environments. Candidates should be comfortable taking ownership of deliverables and contributing independently with minimal supervision.

Key Responsibilities:

- Design, develop, and optimize large-scale data pipelines using Spark and Scala.

- Work on high-volume batch and real-time data processing.

- Develop and maintain ETL workflows and data orchestration pipelines.

- Troubleshoot complex data and performance issues in production environments.

- Perform Spark job tuning and optimization.

- Contribute to cloud migration and data platform modernization initiatives.

- Implement CI/CD pipelines and automated deployment processes.

- Collaborate with cross-functional teams to deliver scalable data solutions.

Required Skills:

- 7+ years of experience in Data Engineering / Big Data Development.

- Strong hands-on experience with Apache Spark, Scala, and Hive.

- Experience with Kafka and distributed data processing.

- Strong programming skills in Scala and/or Python.

- Hands-on experience building and troubleshooting large-scale ETL pipelines.

- Experience with at least one cloud platform: GCP, AWS, or Azure.

- Knowledge of Git, Jenkins, CI/CD, and workflow orchestration tools such as Oozie.

Good to Have:

- GCP services - BigQuery, GCS, Dataproc, and Pub/Sub.

- Experience with cloud migration of on-premise Spark/Hive workloads.

- Experience with large-scale data migration and reconciliation.

- Knowledge of data quality and observability frameworks.

What We're Looking For:

- Someone who can ramp up quickly, independently troubleshoot complex issues, take end-to-end ownership, and deliver production-ready solutions with minimal handholding.

Skills

Data Engineering, Spark, Scala, Hive, Kafka, ETL, Big Dataa, Python, Cloud

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,363,809 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Bengaluru
Data Referral 1 hour ago
In office · 10+ years exp · Pune
Python
SQL
Databases
Snowflake
Databricks
Google BigQuery
AI/ML
Vertex AI
DevOps
GCP
CI/CD
IAM
Cybersecurity
GDPR
Analytics
ETL/ELT
Management
Agile
Apply
In office · Full-Time · 10+ years exp · Bengaluru
Python
SQL
Python
pySpark
Databases
MySQL
PostgreSQL
AI/ML
Spark
Analytics
ETL/ELT
Apply
Data Senior Engineer 4 hours ago
In office · Full-Time · 5+ years exp · Pune
Python
SQL
SAS
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
AI/ML
LangGraph
LangChain
Spark
Airflow
dbt
AI Agents
Great Expectations
DevOps
Azure DevOps
Azure
CI/CD
Git
Amazon S3
Analytics
ETL/ELT
DataStage
Azure Data Factory
AWS Glue
Management
SharePoint
Apply
Remote (India) · 4+ years exp · Gurgaon
Python
SQL
Python
pySpark
Databases
Google BigQuery
AI/ML
Spark
Airflow
DevOps
GCP
CI/CD
Git
Analytics
ETL/ELT
Informatica
Dimensional Modeling
Management
Agile
Apply
Data Engineer - AI 2 hours ago
In office · Full-Time · 3+ years exp · Bachelor's Degree · Chennai
Python
SQL
Python
pySpark
Databases
Microsoft Fabric
AI/ML
Spark
Model Context Protocol
Prompt Engineering
AI Agents
DevOps
Azure
Apply
In office · Full-Time · 12+ years exp · Bengaluru
Python
Java
Bash
Databases
Snowflake
AI/ML
Spark
AI Agents
DevOps
Terraform
Azure
CI/CD
GitOps
Git
AWS
Kubernetes
Incident Management
Linux
Apply
Equity · Hybrid · Full-Time · Bachelor's Degree · Bengaluru
SQL
Management
Agile
Apply
In office · 12+ years exp · Bengaluru
DevOps
AIOps
Windows
Cybersecurity
Zero Trust
Management
ServiceNow
ITSM
Service Desk
Apply
In office · 4+ years exp · Bengaluru
AI/ML
TPU
SpaceTech
Siemens NX
Apply
In office · Full-Time · 2+ years exp · Bachelor's Degree · Bengaluru
Python
JavaScript
TypeScript
Python
FastAPI
Databases
PostgreSQL
AI/ML
Model Context Protocol
Embeddings
AI Agents
Structured Outputs
Machine Learning
Frontend
Next.js
React.js
DevOps
GCP
Vercel
Azure
CI/CD
Git
AWS
Docker
Apply
See all jobs
This is one of many
2,363,809 more open roles from verified company boards, updated every day.