Senior Data Engineer - Python/Apache Spark

ConnectIN Jobs Global · Recruiting & Staffing · IT Staffing & Staff Augmentation · Python · AWS Glue · 2 days ago
Smart Apply
Similar jobs
2,133,637open jobs
135,068companies
250,857added this week
Browse all
Salary
$32k – $48k per year (gross)
Location
In office (Bengaluru, Kochi, Thiruvananthapuram)
Seniority
Senior · 10+ years exp

First seen by Alion on Nov 5, 2026.

Overview
Company
Impact
Profile match

ConnectIN Jobs Global

ConnectIN Jobs Global is an Indian recruitment firm offering recruitment process outsourcing and hiring assistance to employers. It recruits data engineers and Android automotive middleware and infotainment engineers for client companies in Pune, Chennai, Bengaluru, Kochi and Thiruvananthapuram. The company is based in India.
connectinjobsglobal.com · HQ: Pune, India · IT Staffing & Staff Augmentation · Recruiting & Staffing
Tech stack of ConnectIN Jobs Global

Technical Stack :

- AWS EMR

- AWS ECS

- Step Functions

- Apache Spark

- PostgreSQL

- DynamoDB

- Glue

- Apache Iceberg

About the Role :


Key Responsibilities :


- Design and implement endtoend data pipelines using Python and Apache Spark, ensuring high performance and reliability.


- Build and maintain scalable data storage solutions such as DynamoDB, Aurora, PostgreSQL, and Redshift, optimizing for low latency and cost efficiency.


- Architect and deploy data lakehouse structures on AWS, leveraging services like S3, Glue, and Athena to enable unified analytics.


- Develop serverless workflows with AWS Step Functions, Lambda, and EventBridge to automate data ingestion, transformation, and orchestration.


- Participate in Agile ceremonies, contribute to sprint planning, and deliver incremental value in short iterations.


Requirements :


- Proficiency in Python and Spark programming.


- Experience building highly scalable, low-latency data systems (e.g., DynamoDB, Aurora, PostgreSQL, Redshift).


- Proven experience designing and implementing data lakehouse architectures on AWS.


- Hands-on experience with AWS services such as Step Functions, Lambda, and EventBridge.


- Experience in Agile development.

Skills

Data Engineering, AWS EMR, Apache Spark, AWS Glue, Data Pipeline, Python, AWS Lambda, Data Warehousing

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,133,637 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Bengaluru
Data Engineer 3 days ago
In office · Full-Time · 15+ years exp · Hyderabad
SQL
Databases
Snowflake
Google BigQuery
AI/ML
dbt
DevOps
CI/CD
Analytics
ETL/ELT
Fivetran
Management
Agile
Apply
In office · 6+ years exp · Hyderabad
Python
SQL
Databases
Snowflake
AI/ML
Spark
Analytics
ETL/ELT
Apply
In office · Bengaluru
Python
SQL
PowerShell
Databases
MySQL
PostgreSQL
Oracle
MS SQL
DevOps
Windows Server
AWS
Linux
Windows
Unix
Apply
In office · Full-Time · 5+ years exp · Pune
Python
Databases
Snowflake
Databricks
HBase
Apache Kafka
Trino
AI/ML
Hadoop
Spark
AI Agents
DevOps
GCP
Datadog
Azure
AWS
Kubernetes
Grafana
Linux
Cybersecurity
Active Directory
LDAP
Analytics
Apache NiFi
Apply
Data Engineer 1 day ago
Hybrid · Full-Time · 5+ years exp · Bachelor's Degree · Hyderabad
Python
SQL
Databases
MySQL
PostgreSQL
Snowflake
Databricks
Amazon Redshift
AI/ML
Spark
Machine Learning
Mobile
Clean Architecture
DevOps
Rest API
CI/CD
Git
AWS
AWS Lambda
Amazon EC2
Amazon S3
Analytics
Tableau
ETL/ELT
Apply
In office · 5+ years exp · Bachelor's Degree · United States
Python
JavaScript
TypeScript
SQL
C#
C#
.NET
Databases
PostgreSQL
Frontend
Vue.js
Angular
React.js
DevOps
GCP
Azure
CI/CD
AWS
Robotics
Digital Twin
Management
Power Automate
Apply
Hybrid · 6+ years exp · Pune
Python
Bash
DevOps
Terraform
Loki
Terragrunt
Chef
Prometheus
CI/CD
AWS
Kubernetes
Grafana
Configuration Management
OpenStack
Cortex
Incident Management
SLI/SLO/SLA
Linux
TCP/IP
DNS
Cybersecurity
SOC 2
Apply
Remote (India, ET hours) · 3+ years exp · Pune
Python
Go
Bash
DevOps
Terraform
GCP
GitHub Actions
Datadog
Prometheus
Azure
CI/CD
Jenkins
AWS
Grafana
TeamCity
OpenStack
GitHub
Linux
Management
Agile
Scrum
Apply
In office · 7+ years exp · Quezon City
DevOps
GCP
Azure
AWS
VPN
Wi-Fi
BGP
OSPF
Apply
In office · Full-Time · Montreal
JavaScript
TypeScript
SQL
Databases
PostgreSQL
Supabase
AI/ML
Cursor
Claude Code
Lovable
Machine Learning
Frontend
React.js
Management
Zapier
Apply
$29k – $32k per year (gross) · In office · 5+ years exp · Kochi · Kozhikode · Thiruvananthapuram
Python
Python
pySpark
Databases
PostgreSQL
DynamoDB
Amazon Redshift
Amazon Aurora
AI/ML
Spark
DevOps
AWS
AWS Lambda
Amazon ECS
Amazon EventBridge
AWS Step Functions
Analytics
AWS Glue
Management
Agile
Apply
$22k – $32k per year (gross) · In office · 3+ years exp · Pune · Chennai · Thiruvananthapuram
Java
Kotlin
DevOps
Linux
Apply
Android Audio Engineer 2 months ago
$22k – $32k per year (gross) · In office · 4+ years exp · Pune · Chennai · Thiruvananthapuram
Java
Kotlin
C++
Apply
$22k – $32k per year (gross) · In office · 3+ years exp · Pune · Chennai · Thiruvananthapuram
C++
DevOps
Linux
Apply
$22k – $32k per year (gross) · In office · 3+ years exp · Bengaluru · Pune
Java
Kotlin
Apply
In office · Full-Time · 3+ years exp · Master's Degree · Bengaluru
Python
SQL
C#
Perl
MATLAB
SAS
C#
.NET
Databases
Amazon Redshift
AI/ML
Multimodal AI
Transformers
Self-Supervised Learning
Anomaly Detection
Time Series
Amazon SageMaker
Pre-training
Machine Learning
DevOps
AWS
Amazon EC2
Amazon S3
Apply
Sr Data Scientist 1 day ago
In office · Full-Time · Hyderabad · Bengaluru
Python
SQL
AI/ML
NLP
Transformers
TensorFlow
PyTorch
Tokenization
CNN
Sentiment Analysis
Machine Learning
DevOps
Docker
Kubernetes
Apply
In office · 4+ years exp · Bengaluru
JavaScript
TypeScript
PowerShell
Databases
Azure Cosmos DB
Azure SQL Database
Frontend
React.js
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Git
Configuration Management
GitHub
DNS
Cybersecurity
Least Privilege
Microsoft Entra ID
Management
Power Automate
Power Apps
SharePoint
ITIL
Service Desk
Apply
Apply
Senior Tester 1 day ago
In office · Bengaluru
Python
SQL
Bash
Databases
PostgreSQL
Db2
Oracle
DevOps
Azure DevOps
Azure
CI/CD
Jenkins
Git
Linux
Unix
Analytics
ETL/ELT
Management
Jira
Agile
Scrum
QA
Postman
Apply
See all jobs
This is one of many
2,133,637 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles