Senior Data Engineer

Avisoft • Custom Software Development • AI Consulting & Integration • Python • Java • SQL • 21 days ago
Apply now
Similar jobs
910,250open jobs
55,931companies
152,376added this week
Browse all
Salary
≈ $22k – $45k per year (Estimated)
Location
In office (Bengaluru, Hyderabad, Pune)
Seniority
Senior · 6+ years exp

First seen by Alion on Sep 8, 2026.

Overview
Company
Impact
Profile match

Avisoft

Build AI solutions, custom software, enterprise platforms, SaaS products, and data engineering solutions with Avisoft.
avisoft.io • Jammu • Mohali • Bengaluru • Mumbai • Hyderabad • AI Consulting & Integration • Custom Software Development

About the Role :

We are looking for a Senior Data Engineer to build scalable real-time and batch data pipelines for an industrial data platform, processing data from sensors, cameras, APIs, and enterprise systems. The role will support analytics, forecasting, and anomaly detection use cases.

Key Responsibilities :

- Design and develop real-time and batch data pipelines.

- Build data processing solutions using Kafka, Spark, and/or Flink.

- Develop workflows using Airflow and/or dbt.

- Design and maintain data lakes, lakehouses, and data warehouses.

- Implement data models for OLAP/OLTP and optimize pipeline performance.

- Deploy solutions across AWS/GCP/Azure or hybrid environments using Docker/Kubernetes.

- Implement data quality, observability, and infrastructure automation.

Required Skills :

- 6+ years of Data Engineering experience.

- Strong Python/Java and SQL skills.

- Hands-on experience with Kafka, Spark/Flink, Airflow/dbt.

- Experience with Delta Lake/Iceberg and Snowflake/BigQuery/Redshift.

- Strong knowledge of data modelling and Parquet/Avro/ORC.

- Experience with Cloud, Docker, Kubernetes, Terraform/Ansible.

- Exposure to Great Expectations/OpenMetadata.

Good to Have :

- Experience with InfluxDB/TimescaleDB.

- Exposure to aviation, manufacturing, logistics, or industrial IoT domains.

Skills

Data Engineering, Data Pipeline, Kafka, Apache Airflow, Spark, DataLake, Data Warehousing, AWS, Data Observability, Python, SQL

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
910,250 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Bengaluru
Lead Data Engineer 3 hours ago
≈ $154k – $304k per year (Estimated) • In office • 5+ years exp • New York
Python
SQL
Databases
MySQL
PostgreSQL
AI/ML
Copilot
Hadoop
Spark
Claude Code
Frontend
GraphQL
DevOps
CI/CD
AWS
Platform Engineering
AWS Lambda
Analytics
ETL/ELT
Management
Agile
Apply
$164k – $205k per year • In office • 6+ years exp • PhD • South San Francisco
AI/ML
Machine Learning
Apply
≈ $19k – $34k per year (Estimated) • Hybrid • Full-Time • 10+ years exp • Pune
Python
Java
Scala
Databases
Databricks
Delta Lake
AI/ML
Spark
Airflow
DevOps
Terraform
Azure
CI/CD
Docker
Kubernetes
Bicep
Management
Agile
Apply
Senior Data Scientist 8 hours ago
≈ $15k – $30k per year (Estimated) • In office • Full-Time • 7+ years exp • Master's Degree • Pune
Python
SQL
AI/ML
Machine Learning
DevOps
CI/CD
Git
AWS
Apply
$68k – $91k per year • In office • 3+ years exp • Bachelor's Degree • Atlanta
Python
SQL
PowerShell
Analytics
Power BI
Management
Power Automate
Power Apps
Apply
≈ $16k – $41k per year (Estimated) • In office • Full-Time • 10+ years exp • Kuala Lumpur
Python
SQL
Databases
Oracle
Apache Kafka
AI/ML
Replicate
DevOps
Rest API
OpenShift
Dynatrace
CI/CD
Docker
Kubernetes
Grafana
SLI/SLO/SLA
Linux
Apply
Backend Developer 1 day ago
In office • Full-Time • 3+ years exp • Kuala Lumpur
JavaScript
SQL
C#
Node JS
C#
.NET
Databases
PostgreSQL
DevOps
Terraform
GCP
GitLab CI
Azure
CI/CD
Jenkins
Git
AWS
Docker
AWS Lambda
Amazon EC2
Amazon S3
Amazon CloudWatch
API Gateway
Management
Agile
Scrum
Apply
≈ $16k – $41k per year (Estimated) • In office • Full-Time • 4+ years exp • Petaling Jaya
Python
SQL
Databases
Databricks
AI/ML
Spark
MLFlow
Machine Learning
Analytics
ETL/ELT
Apply
Software Engineer 1 day ago
In office • Full-Time • 2+ years exp • Malaysia
Python
JavaScript
SQL
C#
Apply
≈ $50k – $102k per year (Estimated) • Remote (Taiwan) • Full-Time • Bachelor's Degree
Python
JavaScript
Java
Ruby
C++
Databases
Apache Kafka
AI/ML
Copilot
Cursor
Claude
Hadoop
Spark
ChatGPT
Model Context Protocol
Function Calling
LLM
Edge AI
Frontend
Bootstrap
DevOps
GCP
Azure
AWS
Docker
Kubernetes
Amazon CloudWatch
Cybersecurity
SIEM
Apply
Data Engineer 13 days ago
≈ $21k – $42k per year (Estimated) • In office • 5+ years exp • India
Python
SQL
Python
pySpark
Databases
MySQL
PostgreSQL
Snowflake
Databricks
Apache Kafka
AI/ML
Spark
Airflow
dbt
DevOps
GCP
Azure
CI/CD
Git
AWS
Analytics
Power BI
ETL/ELT
Apply
≈ $21k – $43k per year (Estimated) • Remote (India) • 7+ years exp • India
Python
JavaScript
SQL
Node JS
Databases
PostgreSQL
ClickHouse
Apache Kafka
StarRocks
AI/ML
Flink
Frontend
GraphQL
DevOps
Rest API
Terraform
Kubernetes
Amazon Kinesis
Apply
≈ $27k – $71k per year (Estimated) • In office • 10+ years exp • Noida
Python
Java
Databases
Druid
ClickHouse
Apache Iceberg
Presto
Apache Kafka
RocksDB
Amazon Redshift
Trino
AI/ML
Airflow
dbt
DevOps
Terraform
CloudFormation
CI/CD
AWS
Docker
Kubernetes
Amazon EKS
AWS Lambda
GitHub
Amazon S3
IAM
Amazon ECS
Amazon CloudWatch
Cybersecurity
GDPR
Analytics
AWS Glue
Superset
Apply
Full Stack Developer 11 days ago
≈ $16k – $41k per year (Estimated) • In office • 7+ years exp • India
Python
JavaScript
C#
C#
.NET
DevOps
Rest API
Azure
Management
UiPath
Apply
≈ $20k – $40k per year (Estimated) • In office • 7+ years exp • Noida • Mumbai • Hyderabad • Pune
Python
JavaScript
TypeScript
SQL
C#
Databases
PostgreSQL
Azure Cosmos DB
AI/ML
LangGraph
AutoGen
LangChain
LlamaIndex
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
Semantic Kernel
AWS Bedrock
CrewAI
LLM
RAG
Semantic Search
OpenAI
Context Engineering
Semantic Search
LLM Guardrails
Copilot Studio
DevOps
Rest API
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Apply
Sr Workday Analyst 12 hours ago
≈ $13k – $26k per year (Estimated) • In office • Full-Time • 3+ years exp • Chennai • Coimbatore • Hyderabad • Mumbai • Pune
Analytics
Microsoft Excel
Apply
≈ $31k – $69k per year (Estimated) • Hybrid • Full-Time • 10+ years exp • Bachelor's Degree • Bengaluru
Apply
≈ $21k – $48k per year (Estimated) • Hybrid • Full-Time • 5+ years exp • Bachelor's Degree • Bengaluru
Python
Ruby
AI/ML
AI Agents
DevOps
Jenkins
DHCP
Wi-Fi
Management
Jira
Apply
≈ $53k – $110k per year (Estimated) • Hybrid • Full-Time • 12+ years exp • Bachelor's Degree • Pune • Bengaluru • Mumbai • Hyderabad
AI/ML
Edge AI
DevOps
AIOps
Management
Agile
Apply
≈ $18k – $40k per year (Estimated) • In office • Full-Time • 3+ years exp • Bengaluru
Apply
See all jobs
This is one of many
910,250 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles