Location
In office (Mumbai)
Seniority
Senior · 3+ years exp
Employment
Full-Time
Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Dec 26, 2023.
Overview
Company
Impact
Profile match
Events in. Outcomes out.. Somewhere in between: agents that reason, tools that move, and every decision that matters stays yours.
Location: Mumbai
Experience: 4yrsto 8yrs
Technologies / Skills: Advanced SQL, Python and associated librarieslike Pandas, Numpy etc., Pyspark , Shell scripting, DataModelling, Big data, Hadoop, Hive, ETL pipelines.
Responsibilities:
- Proven successin communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and develop data engineering strategy.
- Ability to work with business ownersto define key businessrequirements and convert to user stories with required technical specifications.
- Communicate results and businessimpacts of insight initiatives to key stakeholders to collaboratively solve business problems.
- Working closely with the overall Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence with the best practices and design principles.
- Assures quality, security and compliance requirements are met forsupported area.
- Design and create fault-tolerance data pipelinesrunning on cluster
- Excellent communication skills with the ability to influence client business and IT teams
- Should have design data engineering solutions end to end. Ability to come up with scalable and modular solutions
Required Qualification:
- 3+ years of hands-on experience Designing and developing Data Pipelinesfor Data Ingestion or Transformation using Python (PySpark)/Spark SQL in AWS cloud
- Experience in design and development of data pipelines and processing of data at scale.
- Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments
- Experience in debugging, tunning and optimizing PySpark data pipelines
- Should have implemented concepts and have good knowledge of Pyspark data frames, joins, caching, memory management, partitioning, parallelism etc.
- Understanding of Spark UI, Event Timelines, DAG, Spark config parameters, in order to tune the long running data pipelines.
- Experience working in Agile implementations
- Experience with building data pipelinesin streaming and batch mode.
- Experience with Git and CI/CD pipelines to deploy cloud applications
- Good knowledge of designing Hive tables with partitioning for performance.
Desired Qualification:
- Experience in data modelling
- Hands on creating workflows on any Scheduling Tool like Autosys, CA Workload Automation
- Proficiency in using SDKsfor interacting with native AWS services
- Strong understanding of concepts of ETL, ELT and data modeling.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,326,433 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Mumbai
Senior Data Engineer - Microsoft Fabric
1 hour ago
In office · 7+ years exp · Bengaluru
Python
SQL
Python
pySpark
Databases
PostgreSQL
Databricks
MS SQL
Apache Kafka
Microsoft Fabric
AI/ML
Spark
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Git
Analytics
Tableau
Power BI
ETL/ELT
Azure Data Factory
Apply
Data Architect - AWS
1 hour ago
Remote (India) · 5+ years exp · India
Databases
Amazon Redshift
DevOps
AWS
Amazon S3
Analytics
AWS Glue
Apply
PostgreSQL Database Administrator
11 days ago
In office · Full-Time · 3+ years exp · Bachelor's Degree · Navi Mumbai
Python
SQL
Bash
Databases
MySQL
PostgreSQL
PostGIS
Amazon Aurora
DevOps
Terraform
Ansible
Datadog
Prometheus
CI/CD
AWS
Grafana
Amazon EC2
Amazon S3
IAM
Amazon CloudWatch
Linux
Unix
Apply
Senior Data Scientist (D)
1 day ago
In office · Full-Time · 3+ years exp · Mumbai
Python
SQL
AI/ML
Hadoop
Spark
XGBoost
Scikit-learn
Prophet
TensorFlow
NumPy
PyTorch
Statsmodels
Time Series
Machine Learning
DevOps
AWS
Apply
Senior Data Engineer
1 day ago
In office · 6+ years exp · Bachelor's Degree · Bengaluru
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Spark
DevOps
GCP
Azure
AWS
Analytics
ETL/ELT
Dimensional Modeling
Apply
DB2 Database Engineer
1 day ago
In office · Full-Time · 5+ years exp · Mumbai
Databases
Db2
DevOps
Azure
AWS
Linux
Apply
In office · Full-Time · 8+ years exp · Mumbai
Apply
Apply
Sales Operations Executive - Groups
1 day ago
In office · Full-Time · 1+ year exp · Bachelor's Degree · Mumbai
Apply
In office · Full-Time · 3+ years exp · Bachelor's Degree · Mumbai
Marketing
Salesforce
Apply
This is one of many
2,326,433 more open roles from verified company boards, updated every day.

