2,300,357open jobs
145,988companies
269,708added this week
Browse all
Location
In office (Delhi)
Seniority
Staff
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 16, 2026. First seen by Alion on Nov 16, 2026. Weekday scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Weekday is an Indian recruitment company that sources software engineers through referrals from other engineers rather than through job advertisements or agency databases. Its model pays working engineers to vouch for former colleagues they rate, turning informal knowledge about who is genuinely good into a searchable candidate pool that companies can hire from. Based in Bengaluru and backed by Y Combinator, the platform has layered AI screening and outbound sourcing on top of that referral network, and sells to startups and technology companies hiring in the Indian market.
Backed by Y Combinator

'

: - ( - )

Experience: 6+ yrs

Location: NCR, Delhi, India

As a Lead Data Engineer, you will spearhead the design, development, and optimization of large-scale data pipelines that support both batch and real-time data processing initiatives across the organization. You will collaborate closely with data scientists, product managers, and infrastructure teams to ensure data integrity, scalability, and high performance at every stage of the pipeline, while driving continuous improvement through automation, monitoring, and best practices. Your leadership will shape the data architecture, protect data quality, and enable timely, actionable insights that inform business decisions. In a fast-moving environment, you will balance technical excellence with strategic vision, fostering a culture of collaboration and innovation within the data engineering team.

Requirements

  • Design and implement robust, end-to-end batch data pipelines using tools such as Apache Spark, Hadoop, and Airflow.
  • Develop real-time streaming pipelines with technologies like Apache Kafka, Flink, or Spark Structured Streaming to deliver low-latency analytics.
  • Optimize pipeline performance through partitioning, indexing, and efficient data format selection (e.g., Parquet, ORC).
  • Establish data governance, quality checks, and automated monitoring to ensure data reliability and compliance.
  • Lead capacity planning and scaling strategies for data infrastructure, including cluster management and cost optimization.
  • Mentor and coach junior data engineers, fostering a collaborative and growth-oriented team culture.
  • Collaborate with Data Scientists to translate analytical requirements into scalable pipeline solutions.
  • Drive integration of data pipelines with downstream applications, dashboards, and reporting tools.
  • Stay current with emerging data engineering technologies and evaluate their applicability to business needs.
  • Participate in incident response and root cause analysis to quickly resolve data pipeline failures.
  • 6+ years of experience in data engineering with a proven track record in both batch and real-time processing.
  • Deep knowledge of distributed computing frameworks such as Hadoop, Spark, and Flink.
  • Proficiency in message queuing and stream processing systems like Kafka, Pulsar, or RabbitMQ.
  • Strong scripting skills in Python, Scala, or Java, and experience with SQL on large datasets.
  • Hands-on experience with cloud data services (AWS Glue, Redshift, BigQuery, Snowflake, or Azure Data Factory).
  • Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines for data workloads.
  • Demonstrated ability to architect and scale data pipelines to handle petabyte-scale volumes.
  • Excellent communication skills, capable of translating technical concepts for non-technical stakeholders.
  • A proactive problem-solver with a passion for data quality, governance, and automation.
  • Leadership aptitude, with experience building, mentoring, and growing data engineering teams.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,300,357 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Delhi
Manager Data Science 2 hours ago
In office · 7+ years exp · Noida
Python
SQL
Databases
Snowflake
Databricks
AI/ML
Spark
Scikit-learn
TensorFlow
PyTorch
LLM
Anomaly Detection
Machine Learning
DevOps
AWS
Platform Engineering
Management
Jira
Apply
Lead Data Scientist 2 hours ago
In office · 7+ years exp · Bengaluru
Python
SQL
AI/ML
Scikit-learn
NumPy
Statsmodels
Time Series
DevOps
CI/CD
Git
AWS
Apply
Lead Data Engineer 4C 2 hours ago
Hybrid · Full-Time · Bachelor's Degree · Hyderabad
SQL
Databases
Snowflake
Databricks
Oracle
Apache Kafka
AI/ML
Spark
Airflow
AI Agents
DevOps
Terraform
Azure
CI/CD
Git
AWS
Analytics
ETL/ELT
Apply
In office · 12+ years exp · Bengaluru · Mumbai
Databases
Snowflake
DevOps
GCP
Azure
AWS
Analytics
Power BI
ETL/ELT
Informatica
Talend
Collibra
Apply
In office · 13+ years exp · Bengaluru · Mumbai
Python
SQL
Python
pySpark
Databases
Databricks
Microsoft Fabric
AI/ML
Spark
DevOps
Azure DevOps
GitHub Actions
Azure
CI/CD
Git
Analytics
Power BI
Azure Data Factory
Apply
In office · 6+ years exp · Kolkata · Delhi
Python
SQL
Python
FastAPI
Databases
PostgreSQL
AI/ML
LangGraph
LangChain
Embeddings
Prompt Engineering
Function Calling
AI Agents
LLM
RAG
Hallucination
Time Series
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
Machine Learning
DevOps
GCP
Azure
CI/CD
Git
AWS
Docker
Apply
In office · 5+ years exp · Mohali · Bathinda · Patiala · Delhi · Rewari
Apply
L2 Mac Developer 1 day ago
In office · 4+ years exp · Bengaluru · Delhi · Gurgaon
C++
Web3
Layer 2
Apply
Operations Lead 2 days ago
$11k – $21k per year · In office · Full-Time · Delhi
Apply
Senior ML Engineer 2 days ago
In office · Full-Time · Delhi
Python
SQL
Python
bandit
Databases
Databricks
AI/ML
Spark
XGBoost
Reinforcement Learning
Transfer Learning
LightGBM
TensorFlow
PyTorch
Recommender Systems
Machine Learning
DevOps
GCP
Azure
AWS
Analytics
A/B Testing
Apply
See all jobs
This is one of many
2,300,357 more open roles from verified company boards, updated every day.