2,336,973open jobs
146,756companies
281,661added this week
Browse all
Location
In office (Pune)
Seniority
Senior

Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Oct 21, 2026. NewVision Software & Consultancy scores B on the Alion truth index.

Overview
Company
Impact
Profile match
An AI-first engineering partner for audit and tax, BFSI, healthcare, High Tech, and their GCCs. 150+ projects, ISO 27001:2022. A SoftServe company.

The earlier req for this position was closed with -ve BGV candidate. Thus, opening a new one.

Role: Senior Azure Databricks Developer

Role Summary:

Senior Databricks Engineer with strong expertise in developing, optimizing, and maintaining data engineering solutions on the Databricks platform. The candidate should have deep experience with Apache Spark (PySpark), Databricks notebooks, Delta Lake, and Spark performance optimization. This role is focused on Spark-native data engineering rather than ETL tool development.

Must Have Skills:

  • Strong hands-on experience with Databricks notebooks, Jobs, Workflows, Repos, and Unity Catalog
  • Strong expertise in PySpark and Spark SQL
  • Experience building scalable Spark-based data pipelines
  • Strong understanding of Spark DataFrames, joins, aggregations, window functions, and distributed processing
  • Experience with Delta Lake (MERGE, OPTIMIZE, ZORDER, VACUUM, Change Data Feed)
  • Hands-on experience in Spark job performance tuning
  • Experience optimizing partitions, shuffles, caching, memory usage, and cluster utilization
  • Experience developing batch and incremental data processing pipelines
  • Strong programming skills in Python, PySpark, and SQL
  • Experience working on Azure Databricks, AWS Databricks, or GCP Databricks
  • Experience with Git, CI/CD, code reviews, testing, and production deployments
  • Implement event-driven data flows and real-time data ingestion using Apache Kafka.
  • Develop and integrate REST APIs for both data extraction and downstream data serving.
  • Monitor, tune, and optimize PySpark workloads for maximum performance and cost efficiency.
  • Communicate effectively with cross-functional stakeholders to gather requirements and translate them into scalable technical solutions.
  • Mentor junior developers, guide architectural decisions, and prepare to take on team lead responsibilities in the future. as nice to have.

Good to Have Skills:

  • Experience with Lakehouse and Medallion architecture
  • Knowledge of Data Modeling and Data Governance

Nice to Have Skills:

  • Experience with Delta Live Tables (DLT)
  • Experience mentoring teams or leading technical discussions
  • Experience with Photon and Databricks Asset Bundles
  • Experience with Cluster Policies and Workspace Administration
  • Design, build, and maintain robust batch and streaming data pipelines using Databricks and PySpark.
  • Extract complex data from a variety of upstream sources (databases, internal/external APIs, flat files) and process it into the data lake.
  • Architect and optimize Delta Tables, utilizing the Medallion architecture (Bronze, Silver, Gold layers) for structured data governance.

Soft skills:

  • Must have strong written and verbal communication skills, excellent articulation skills, and experience working with client teams.

The candidate should have actively participated in and contributed to sprint planning and solution design.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,336,973 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Backend
Similar stack
Same company
Pune
In office · 3+ years exp · Bachelor's Degree · Gurgaon
Python
Bash
DevOps
Rest API
Terraform
GCP
Chef
Prometheus
Azure
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Grafana
Configuration Management
Linux
Unix
Apply
Hybrid · Full-Time · Bachelor's Degree · Gurgaon
Apex
Apex
Lightning Web Components
MuleSoft
Visualforce
AI/ML
Claude
Prompt Engineering
AI Agents
LLM
OpenAI
DevOps
Rest API
Azure
CI/CD
AWS
Kubernetes
SOAP
Management
Draw.io
Agile
Scrum
Apply
In office · Full-Time · 3+ years exp · Bachelor's Degree · Bengaluru
C++
AI/ML
Machine Learning
DevOps
Git
Linux
Apply
In office · Full-Time · 3+ years exp · Bachelor's Degree · Bengaluru
C++
AI/ML
Machine Learning
DevOps
Git
Linux
Apply
In office · Full-Time · 10+ years exp · Bachelor's Degree · Bengaluru
Python
JavaScript
Java
Databases
Apache Kafka
Google BigQuery
AI/ML
Spark
Frontend
GraphQL
Bootstrap
DevOps
Rest API
Linux
Apply
In office · 7+ years exp · Bachelor's Degree · Pune
Python
SQL
AI/ML
Spark
Fine-tuning
Embeddings
Prompt Engineering
NLP
LLM
RAG
OpenAI
Text-to-Speech
DevOps
GCP
Azure
AWS
Apply
In office · 10+ years exp · Pune
Python
Java
Java
Apache Tomcat
DevOps
CI/CD
Docker
Kubernetes
Platform Engineering
Apply
≈ $18k – $41k per year (Estimated) · Hybrid · Full-Time · 5+ years exp · Bachelor's Degree · Bengaluru · Pune
Python
PowerShell
DevOps
Azure
AWS
Kubernetes
Incident Management
Cybersecurity
PKI
Management
ITIL
MedTech
CAPA
Apply
Hybrid · Full-Time · 6+ years exp · Pune
JavaScript
Java
TypeScript
SQL
Java
Maven
Spring Boot
Hibernate
Spring Security
Gradle
Databases
Oracle
Frontend
Angular
Mobile
JUnit
DevOps
Rest API
CI/CD
Git
GitHub
Linux
Unix
Cybersecurity
Snyk
SonarQube
Checkmarx
PCI DSS
Management
Agile
Apply
≈ $18k – $46k per year (Estimated) · In office · Full-Time · Bachelor's Degree · Pune
JavaScript
TypeScript
Node JS
Frontend
RxJS
Angular
Bootstrap
npm
Sass
Mobile
Dependency Injection
Reactive Programming
DevOps
CI/CD
Management
Confluence
Agile
Apply
See all jobs
This is one of many
2,336,973 more open roles from verified company boards, updated every day.