Databricks Data Engineer

KPI Partners • Analytics & BI Consulting • Data Engineering & Migration Services • Python • SQL • ETL/ELT • 1 day ago
Smart Apply
Similar jobs
1,880,211open jobs
110,342companies
256,528added this week
Browse all
Salary
≈ $21k – $42k per year (Estimated)
Location
Remote (India)
Experience
5+ years exp

First seen by Alion on Oct 20, 2026.

Overview
Company
Impact
Profile match

KPI Partners

KPI Partners is a US based IT company that provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications and big data.
kpipartners.com • Bengaluru • London • Hyderabad • Pune • Oakland • Data Engineering & Migration Services • Analytics & BI Consulting • 201-500 employees • Est. 2006
Tech stack of KPI Partners

We are looking for a Data Engineer with strong experience in Databricks, Airflow, Python, and SQL to build and maintain scalable data pipelines and data processing solutions. The ideal candidate will have expertise in ETL/ELT development, workflow orchestration, data modelling, and performance optimisation.


Responsibilities:

  • Develop and optimise data pipelines using Databricks, Python, and SQL.
  • Design and manage workflow orchestration using Apache Airflow.
  • Build scalable ETL/ELT processes for data ingestion and transformation.
  • Monitor, troubleshoot, and improve data pipeline performance.
  • Implement data quality checks and validation frameworks.
  • Collaborate with cross-functional teams to deliver data-driven solutions.


Requirements:

  • Strong hands-on experience with Databricks and PySpark.
  • Expertise in Apache Airflow DAG development and orchestration.
  • Proficiency in Python and advanced SQL.
  • Experience with data warehousing and cloud-based data platforms.
  • Knowledge of performance tuning, data modelling, and ETL best practices.
  • Preferred Skills: Experience with AWS, Azure, or GCP.
  • Familiarity with Delta Lake, CI/CD, and Agile methodologies.
  • Experience: 5-9 years of experience.

Skills

Airflow, Apache Airflow, Databricks, PySpark, Python

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,880,211 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
India
$160k – $195k per year • Equity • Remote (United States) • 5+ years exp • Bachelor's Degree
Python
SQL
Databases
Google BigQuery
BigQuery
AI/ML
Spark
Claude Code
AI Agents
Machine Learning
DevOps
GCP
AWS
Management
Agile
Apply
≈ $37k – $95k per year (Estimated) • Remote (Costa Rica) • Full-Time • 5+ years exp • San José
Python
SQL
Databases
Snowflake
DynamoDB
Google BigQuery
BigQuery
DevOps
AWS
AWS Lambda
Amazon S3
Amazon Kinesis
Analytics
ETL/ELT
Domo
Management
Agile
Apply
$180k – $300k per year • Remote (United States) • Irvine
Python
Databases
Snowflake
Databricks
AI/ML
LangGraph
AutoGen
LangChain
Spark
AI Agents
CrewAI
LLM
RAG
Google ADK
Time Series Forecasting
Agentic Workflows
Tool Use
Machine Learning
DevOps
GCP
Azure
AWS
Kubernetes
Apply
≈ $25k – $68k per year (Estimated) • Remote (Mexico) • Full-Time • 3+ years exp • Aguascalientes
AI/ML
Copilot
Analytics
Microsoft Excel
Apply
$110k – $146k per year • Remote (United States) • 12+ years exp • Bachelor's Degree • United States
Python
Java
SQL
PowerShell
C#
Databases
PostgreSQL
DevOps
Red Hat
VMWare
Azure
AWS
Docker
Kubernetes
CentOS Stream
Amazon S3
Linux
Cybersecurity
Wireshark
Apply
Hybrid • Full-Time • São Paulo
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Spark
DevOps
Azure DevOps
GitHub Actions
Azure
CI/CD
Git
Gitflow
GitHub
Analytics
ETL/ELT
Apply
≈ $77k – $147k per year (Estimated) • In office • 3+ years exp • Bachelor's Degree • Murfreesboro
Python
PowerShell
DevOps
Terraform
Ansible
Azure
Cybersecurity
SentinelOne
Zero Trust
Microsoft Entra ID
Active Directory
SIEM
DLP
Apply
≈ $21k – $43k per year (Estimated) • Hybrid • Full-Time • 6+ years exp • Bengaluru
Python
PowerShell
DevOps
Terraform
GCP
Azure DevOps
GitHub Actions
Azure
CI/CD
Git
AWS
Platform Engineering
Bicep
Cybersecurity
Checkov
tfsec
Cryptography
Vault
Apply
$56k – $68k per year (net) • In office • Poznań
PHP
SQL
PHP
Magento
Xdebug
DevOps
Docker
Apply
In office • Full-Time • 2+ years exp • Chennai
JavaScript
Java
TypeScript
SQL
Java
Maven
Spring Security
Apache Tomcat
Databases
MySQL
Oracle
AI/ML
Copilot
Prompt Engineering
AI Agents
RAG
Frontend
Redux
Angular
Sass
DevOps
Rest API
Splunk
Prometheus
WebSockets
Grafana
Apache HTTP Server
Cybersecurity
Snyk
SonarQube
QA
Jest
Apply
≈ $21k – $44k per year (Estimated) • Remote (likely India) • 5+ years exp • Hyderabad • Bengaluru • Pune
Python
SQL
Databases
Snowflake
AI/ML
Airflow
dbt
Apply
≈ $29k – $55k per year (Estimated) • Remote (likely India) • 23+ years exp • Bengaluru • Hyderabad • Pune
SQL
Databases
Snowflake
Databricks
Google BigQuery
Amazon Redshift
BigQuery
AI/ML
Airflow
dbt
DevOps
Azure
Analytics
Power BI
ETL/ELT
Looker
Cognos
SSAS
Apply
Data Scientist 7 days ago
≈ $16k – $40k per year (Estimated) • In office • 4+ years exp • Bengaluru
Python
AI/ML
Prompt Engineering
AI Agents
LLM
RAG
Apply
≈ $23k – $47k per year (Estimated) • In office • 5+ years exp • Bengaluru
Python
SQL
Databases
Snowflake
AI/ML
dbt
Analytics
ETL/ELT
Apply
Azure Data Engineer 1 month ago
≈ $22k – $45k per year (Estimated) • In office • 6+ years exp • Bengaluru • Hyderabad • Pune
Python
SQL
Scala
Python
pySpark
Databases
Azure SQL Database
AI/ML
Spark
DevOps
Azure
Analytics
Azure Data Factory
Apply
Sr. Data Architect 1 day ago
≈ $29k – $54k per year (Estimated) • Remote (India) • 9+ years exp • India
Python
JavaScript
Scala
Databases
Databricks
AI/ML
Spark
Frontend
Bootstrap
DevOps
GCP
Azure
CI/CD
AWS
Apply
Data Engineer 1 day ago
≈ $21k – $42k per year (Estimated) • Remote (India) • 6+ years exp • India
Python
SQL
Python
pySpark
Databases
Snowflake
Delta Lake
Azure SQL Database
Microsoft Fabric
AI/ML
Spark
DevOps
Azure
Cybersecurity
Microsoft Entra ID
Analytics
Power BI
ETL/ELT
Azure Data Factory
Apply
VMC/HMC/CNC Operator 11 hours ago
≈ $5k – $10k per year (Estimated) • In office • Full-Time • 1+ year exp • India
Apply
≈ $10k – $23k per year (Estimated) • In office • Full-Time • 5+ years exp • India
Apply
≈ $9k – $26k per year (Estimated) • In office • Full-Time • 4+ years exp • Bachelor's Degree • India
Apply
See all jobs
This is one of many
1,880,211 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles