2,326,433open jobs
146,547companies
277,274added this week
Browse all
Location
In office (Mumbai)
Seniority
Staff · 4+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Apr 20, 2026.

Overview
Company
Impact
Profile match
Events in. Outcomes out.. Somewhere in between: agents that reason, tools that move, and every decision that matters stays yours.

Technologies / Skills:

Advanced SQL, Python and associated libraries like Pandas, Numpy etc., Pyspark , Shell scripting, DataModelling, Big data, Hadoop , Hive, ETL pipelines and IaC tools like Terraform etc.

Responsibilities:

  • Proven success in communicating with users, other technical teams, and senior management to
  • Collect requirements, describe data modeling decisions and develop data engineering strategy.
  • Ability to work with business owners to define key business requirements and convert to user stories with required technical specifications.
  • Communicate results and business impacts of insight initiatives to key stakeholders to collaboratively solve business problems.
  • Working closely with the overall Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence with the best practices and design principles.
  • Assures quality, security and compliance requirements are met for supported area.
  • Design and create fault-tolerance data pipelines running on cluster
  • Excellent communication skills with the ability to influence client business and IT teams
  • Should have design data engineering solutions end to end. Ability to come up with scalable and modular solutions

Required Qualification:

  • 7 years of relevant IT experience
  • 4+ years of hands-on experience Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL in AWS cloud
  • Experience in design and development of data pipelines and processing of data at scale using technologies like EMR, Kinesis, Kafka, Lambda, Glue, Athena, Redshift, Step Functions.
  • Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments
  • Experience in debugging, tunning and optimizing PySpark data pipelines
  • Should have implemented concepts and have good knowledge of Pyspark dataframes, joins, caching, memory management, partitioning, parallelism etc.
  • Understanding of Spark UI, Event Timelines, DAG, Spark config parameters, in order to tune the long running data pipelines.
  • Experience working in Agile implementations
  • Experience with building data pipelines in streaming and batch mode.
  • Experience with Git and CI/CD pipelines to deploy cloud applications
  • Good knowledge of designing Hive tables with partitioning for performance

Desired Qualification:

  • Experience in data modelling
  • Hands on creating workflows on any Scheduling Tool like Autosys, CA Workload Automation
  • Proficiency in using SDKs for interacting with native AWS services
  • Strong understanding of concepts of ETL, ELT and data modeling
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,326,433 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Mumbai
Remote (India) · 5+ years exp · India
Databases
Amazon Redshift
DevOps
AWS
Amazon S3
Analytics
AWS Glue
Apply
In office · 8+ years exp · Bachelor's Degree · Hyderabad
Python
SQL
Scala
Databases
Snowflake
Databricks
Apache Kafka
AI/ML
Copilot
Spark
LLM
RAG
Frontend
GraphQL
DevOps
Rest API
Azure
Git
Analytics
Azure Data Factory
Management
Agile
Apply
Data Engineer - Lead 4 hours ago
In office · 5+ years exp · Noida
Python
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
Apache Kafka
AI/ML
Spark
Airflow
AI Agents
DevOps
Platform Engineering
Amazon Kinesis
Apply
In office · Full-Time · 5+ years exp · Hyderabad
Python
SQL
Python
pySpark
Databases
Google BigQuery
AI/ML
Spark
DevOps
GCP
CI/CD
Git
Management
Agile
Apply
Azure Databricks 9 hours ago
In office · Full-Time · 9+ years exp · Chennai
SQL
Databases
Databricks
Delta Lake
AI/ML
Machine Learning
DevOps
Azure
Apply
In office · Full-Time · 5+ years exp · Mumbai
Databases
Db2
DevOps
Azure
AWS
Linux
Apply
In office · Full-Time · 8+ years exp · Mumbai
Apply
In office · Full-Time · Bachelor's Degree · Mumbai
Apply
In office · Full-Time · 1+ year exp · Bachelor's Degree · Mumbai
Apply
In office · Full-Time · 3+ years exp · Bachelor's Degree · Mumbai
Marketing
Salesforce
Apply
See all jobs
This is one of many
2,326,433 more open roles from verified company boards, updated every day.