368,530open jobs
9,432companies
50,439added this week
Browse all
Salary
$30k – $68k per year (Estimated)
Location
In office (Gurgaon)
Seniority
Staff · 7+ years exp
Overview
Company
Impact
Profile match
DTDL (Digital Transformation and Data Analytics Solutions) is an Indian technology firm specializing in digital solutions, data management, and enterprise IT services. The company provides customized software development, cloud integration, and advanced analytics to help businesses optimize their operations and scale efficiently. Based in India, it serves as a digital transformation partner for organizations looking to leverage technology for business growth and modernization.

Looking for a hands-on Lead Data Engineer to build scalable data pipelines and data products using Data Mesh principles. This is a core engineering role involving end-to-end system design, development, and optimisation.

Responsibilities:

  • Build and maintain batch and real-time (streaming) data pipelines.
  • Develop domain-driven data products and ensure data quality and reliability.
  • Implement data contracts, governance, and observability.
  • Optimise query performance and cost.
  • Work closely with business and domain teams.

Requirements:

  • 7+ years in Data Engineering.
  • Strong SQL and Python.
  • Experience with data modelling (star schema, normalisation).
  • Hands-on with Apache Airflow (or similar).
  • Experience with large-scale data processing.

Streaming / Real-Time (Important):

  • Hands-on experience with real-time streaming pipelines.
  • Tools like Apache Kafka, Spark Streaming, or similar.
  • Understanding of event-driven architecture and Kappa architecture.

Tech Stack (Flexible):

  • Any Data Warehouse (Snowflake / BigQuery / Redshift, etc. )
  • Spark / PySpark.
  • dbt / Dataform or similar.
  • Object storage (S3 or similar).
  • Hands-on experience with AWS (S3 Redshift, EMR, Glue or similar services).

Good to Have:

  • Data Mesh / Data Product experience.
  • Strong ownership and independent working style.
  • Experience working with analysts/stakeholders.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
368,530 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Gurgaon
$220k – $325k per year • Remote/Hybrid • Full-Time • 15+ years exp • New York
DevOps
AWS
Azure
CI/CD
GCP
Kubernetes
Platform Engineering
Cybersecurity
Threat Modeling
Apply
Remote/Hybrid • 7+ years exp • Bachelor's Degree
C#
JavaScript
Python
SQL
TypeScript
C#
ASP.NET Core
Blazor
Dapper
Databases
Oracle
Frontend
Angular
Bootstrap
JQuery
Vue.js
DevOps
AWS
Azure
Azure DevOps
CI/CD
Git
Apply
$30k – $101k per year (Estimated) • Remote/Hybrid • 4+ years exp • Madrid
Java
Java
Spring Boot
Databases
Apache Kafka
DevOps
Dynatrace
Apply
$54k – $122k per year (Estimated) • Remote/Hybrid • Madrid
Java
Java
Spring Boot
Databases
Apache Kafka
DevOps
Dynatrace
Apply
$26k – $90k per year (Estimated) • Remote/Hybrid • 2+ years exp • Madrid
Python
Python
Celery
Django
Databases
Apache Kafka
MySQL
PostgreSQL
RabbitMQ
Redis
Apply
$37k – $81k per year (Estimated) • In office • Internship • 13+ years exp • Gurgaon
Go
Java
Kotlin
Node JS
Objective-C
Python
Swift
JavaScript
Databases
Apache Kafka
ElasticSearch
MySQL
PostgreSQL
Redis
DevOps
AWS
Azure
CI/CD
GCP
Platform Engineering
Apply
$36k – $81k per year (Estimated) • In office • Gurgaon
AI/ML
ElevenLabs
LangChain
LangGraph
LLM
Prompt Engineering
RAG
AI Agents
DevOps
AWS
Azure
GCP
Apply
$29k – $56k per year (Estimated) • In office • 6+ years exp • Gurgaon
Python
SQL
Python
pySpark
Databases
Apache Iceberg
Google BigQuery
AI/ML
Airflow
dbt
Spark
DevOps
CI/CD
GCP
Git
Platform Engineering
Terraform
Apply
$28k – $66k per year (Estimated) • In office • Internship • 11+ years exp • Bachelor's Degree • Gurgaon
SQL
Databases
Amazon Redshift
Apache Kafka
Databricks
Google BigQuery
MySQL
PostgreSQL
Snowflake
AI/ML
Airflow
Hadoop
Spark
DevOps
AWS
AWS Lambda
CI/CD
Docker
GCP
Kubernetes
Amazon Kinesis
Amazon S3
Analytics
ETL/ELT
Apply
Engineering Manager 3 days ago
$37k – $82k per year (Estimated) • In office • Delhi
AI/ML
AI Agents
LLM
Prompt Engineering
RAG
Human-in-the-Loop
DevOps
Platform Engineering
Rest API
Vector
Apply
$16k – $36k per year (Estimated) • In office • Full-Time • 2+ years exp • Bachelor's Degree • Gurgaon
Apply
$26k – $69k per year (Estimated) • In office • Full-Time • 5+ years exp • Gurgaon
Java
DevOps
Git
Apply
$32k – $83k per year (Estimated) • In office • Full-Time • 5+ years exp • Gurgaon
Python
Python
pySpark
Databases
Microsoft Fabric
AI/ML
Spark
DevOps
Azure
Apply
$24k – $65k per year (Estimated) • In office • Full-Time • 3+ years exp • Gurgaon
Databases
Snowflake
Apply
$22k – $57k per year (Estimated) • Remote/Hybrid • Full-Time • 4+ years exp • Noida • Gurgaon
C++
Apply
See all jobs
This is one of many
368,530 more open roles from verified company boards, updated every day.