2,333,331open jobs
146,617companies
280,853added this week
Browse all
Location
In office (Noida)
Seniority
Staff · 10+ years exp

First seen by Alion on Nov 17, 2026.

Overview
Company
Impact
Profile match
Provana is an information technology services company that builds and supports enterprise applications on .NET, SQL Server and Azure. Its teams cover cloud engineering, business intelligence and reporting, and finance and HR transformation consulting, working in night shifts for clients abroad. The company is headquartered in India, with its office in Noida.

Role Overview :

We are seeking a high-caliber Technical Lead to spearhead the design and development on our enterprise-scale Databricks data platform. As a hands-on lead, you will be the primary authority on our Azure-based Lakehouse, ensuring that data pipelines are not just functional, but scalable, secure, and cost-optimized. You must have a proven track record of leading end-to-end implementations - from initial discovery and schema design to production deployment and monitoring.

Core Requirements :

- 10 - 12 + years of experience in Data Engineering

- Azure Mastery: Minimum 3 + years of lead experience specifically within the Azure cloud ecosystem (ADLS Gen2, Azure Data Factory, Azure Synapse, and Azure Key Vault, Azure functions).

- Databricks Expertise: Deep hands-on experience with Databricks (Spark/PySpark), specifically implementing Medallion Architecture (Bronze, Silver, Gold layers).

- Conversant with streaming and batch data processing.

- Proven Leadership: Must have led at least two full-lifecycle, end-to-end data platform implementations in a Tech Lead capacity.

- Proven Tech Lead experience on both Databricks and Azure

- Excellent understanding of Lakehouse architecture

- Very strong SQL skills and data modeling expertise is a must.

- Strong experience with GenAI-assisted development. Should have used GitHub Copilot, Claude Code, Codex or equivalent; AI-assisted code generation, refactoring, testing, documentation and debugging using GenAI tools.

- Should be conversant with LLM APIs, RAG, embeddings, vector databases, structured outputs, model selection, latency and token-cost optimization.

- Should be familiar with agentic development and loop engineering.

Key Responsibilities :

- Architectural Design: Lead the design and evolution of our Delta Lakehouse architecture, ensuring it supports both high-volume and complex batch processing.

- End-to-End Implementation: Take full ownership of the data lifecycle: ingestion from disparate sources (APIs, RDBMS, NoSQL), complex transformations in PySpark, and final exposure via Gold tables or semantic layers.

- Technical Mentorship: Guide a team of 3 - 5 data engineers through code reviews, design workshops, and the establishment of "best-in-class" Python and SQL coding standards.

- Optimization: Conduct performance tuning of Spark clusters by exploring all available options like optimizing shuffle partitions and managing "Small File" problems to reduce Azure consumption costs.

- Data Governance: Implement and manage Databricks Unity Catalog for centralized fine-grained access control, lineage tracking, and data discovery.

- Handle production issues, root-cause analysis, and long-term fixes.

Technical Skills & Toolset :

- Languages: Expert-level Python (PySpark) and Advanced SQL. Familiarity with .net framework or Java is a plus.

- Orchestration: Advanced use of Azure Data Factory (ADF) and Databricks Workflows/Jobs for complex dependency management.

- DevOps/DataOps: Strong proficiency in Azure DevOps or GitHub Actions, specifically building CI/CD pipelines for automated Databricks notebook deployment and Infrastructure as Code (Terraform/Bicep).

- Observability: Implementation of data quality frameworks (e.g., Great Expectations or Databricks Expectations) and monitoring via Azure Monitor/Log Analytics.

Preferred Qualifications :

- Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) or Databricks Certified Data Engineer Professional.

- AI/ML Integration: Experience supporting ML workloads by building feature stores and integrating with MLflow.

- Agile: Experience working in a high-velocity Scrum and Kanban environment.

Soft Skills :

- Strong ownership mindset and accountability

- Excellent communication with technical and non-technical stakeholders

Skills

Data Engineering, Databricks, Azure, Python, SQL, Azure Data Factory, Generative AI, LLM, RAG, CI/CD, Synapse Analytics

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,333,331 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Noida
In office · 8+ years exp · Noida
SQL
Databases
MS SQL
AI/ML
Prompt Engineering
AI Agents
Analytics
Power BI
ETL/ELT
SSIS
Management
Agile
Scrum
Apply
In office · Full-Time · 8+ years exp · Bengaluru
Python
Bash
Databases
Snowflake
AI/ML
Spark
AI Agents
DevOps
Terraform
Azure
CI/CD
GitOps
Git
Incident Management
Linux
Apply
Lead Data Scientist 3 hours ago
In office · Mumbai
Python
SQL
AI/ML
Spark
Computer Vision
Machine Learning
Apply
In office · 10+ years exp · Chennai
Python
Python
pySpark
Databases
Databricks
Microsoft Fabric
AI/ML
Spark
DevOps
Azure
Analytics
ETL/ELT
Azure Data Factory
Apply
Lead Data Engineer 4 hours ago
Remote (India) · Full-Time · 7+ years exp · Bengaluru · Hyderabad
Python
SQL
Python
pySpark
Databases
Snowflake
Weaviate
Databricks
Delta Lake
Milvus
Pinecone
AI/ML
Spark
MLFlow
Embeddings
Prompt Engineering
AI Agents
LLM
RAG
OpenAI
Knowledge Graph
DevOps
Azure
CI/CD
Git
Analytics
ETL/ELT
Apply
In office · 7+ years exp · Noida
Python
SQL
Databases
Snowflake
Databricks
AI/ML
Spark
Scikit-learn
TensorFlow
PyTorch
LLM
Anomaly Detection
Machine Learning
DevOps
AWS
Platform Engineering
Management
Jira
Apply
In office · 4+ years exp · Noida
Python
SQL
Python
FastAPI
Databases
Snowflake
Neo4j
Databricks
Google BigQuery
Amazon Redshift
Amazon Neptune
AI/ML
DGL
Embeddings
NLP
PyTorch
PubMed
Machine Learning
DevOps
CI/CD
Git
Docker
Analytics
ETL/ELT
QA
Pytest
Apply
Team Leader_CTVS 1 day ago
In office · Noida
Apply
Hybrid · Full-Time · Bachelor's Degree · Noida
DevOps
CI/CD
Management
Agile
Apply
Hybrid · Full-Time · 15+ years exp · Bachelor's Degree · Noida
DevOps
Terraform
Ansible
GCP
Azure
CI/CD
GitOps
Jenkins
AWS
Docker
Kubernetes
Platform Engineering
FinOps
GitLab
Cybersecurity
HashiCorp Vault
Apply
See all jobs
This is one of many
2,333,331 more open roles from verified company boards, updated every day.