2,385,015open jobs
148,810companies
289,953added this week
Browse all
Salary
≈ $20k – $43k per year (Estimated)
Location
In office (Hyderabad, Chennai, Bengaluru)
Seniority
Senior · 7+ years exp

First seen by Alion on Sep 17, 2026.

Overview
Company
Impact
Profile match
We are an Analytics & Consulting firm providing value based solutions to small and medium enterprises across USA & Asia. We help you with our customised data management, dashboarding, advanced analytics services.

Role Overview:

Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, and Generative AI technologies.

Key Responsibilities:

- Design, develop, and maintain end-to-end streaming and batch data pipelines using Databricks and PySpark.

- Build, optimize, and manage Delta Lake tables within Unity Catalog.

- Develop and support Lakeflow pipelines with incremental processing, CDC, and data quality validations.

- Integrate enterprise systems into the Databricks Lakehouse.

- Ensure data quality, governance, security, and operational excellence across platforms.

- Monitor, troubleshoot, and optimize workflows for reliability and performance.

- Collaborate with stakeholders to deliver scalable, business-aligned solutions.

- Build and support AI-powered data solutions leveraging LLMs, RAG, and vector search.

- Implement CI/CD best practices and maintain deployment pipelines.

- Drive deliverables independently, proactively resolving challenges with minimal supervision.

Tech Stack & Requirements :

- Hands-on experience with Databricks and modern Lakehouse architecture.

- Expertise in PySpark, Spark Structured Streaming, SQL, NoSQL databases, Delta Lake.

- Proficiency with Unity Catalog for governance and security.

- Experience building AI agents, copilots, and generative AI solutions using LLMs, RAG, and vector search.

- Experience with Git-based source control, CI/CD pipelines, Databricks Repos, and Databricks Asset Bundles.

Educational Qualifications :

- BE/BTech/ME/MTech/MCA only.

Skills

Data Engineering, Generative AI, PySpark, Data Quality, SQL, NoSQL, LLM

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,385,015 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Hyderabad
In office · Biberach
Python
SQL
Databases
Databricks
DevOps
Azure
CI/CD
Git
Platform Engineering
Analytics
Power BI
ETL/ELT
SSIS
SSAS
Apply
Hybrid · Internship · Nanterre
Apply
In office · Full-Time · Berlin · Hamburg · Bremen
SQL
Databases
Google BigQuery
AI/ML
dbt
DevOps
GCP
Analytics
Data Vault
Dimensional Modeling
Apply
Senior Data Scientist 7 hours ago
$200k – $240k per year · In office · Full-Time · 5+ years exp · PhD · New York
Python
SQL
Databases
Google BigQuery
AI/ML
dbt
SciPy
NumPy
LLM
Statsmodels
Analytics
A/B Testing
Apply
Remote (Albania) · Full-Time
Python
SQL
Analytics
Dimensional Modeling
Apply
Sr. Data Engineer 15 days ago
$78k – $156k per year · In office · Full-Time · 5+ years exp · High School Diploma · Madison
Python
SQL
Databases
Snowflake
Databricks
Delta Lake
AI/ML
Spark
DevOps
Rest API
AWS
GitLab
Amazon S3
Analytics
ETL/ELT
Management
Confluence
Jira
Agile
Apply
In office · Full-Time · 10+ years exp · Belgrade
Python
SQL
Scala
Databases
Snowflake
Databricks
Microsoft Fabric
AI/ML
Spark
dbt
DevOps
CI/CD
AWS
Platform Engineering
FinOps
Analytics
Power BI
Collibra
Alation
Apply
$177k – $239k per year · In office · Full-Time · 10+ years exp · Bachelor's Degree · Mountain View
Python
SQL
SAS
Databases
Databricks
Analytics
Tableau
Apply
Hybrid · Full-Time · 8+ years exp · Bengaluru
Python
SQL
Databases
Snowflake
Microsoft Fabric
AI/ML
Airflow
dbt
AI Agents
LLM
RAG
Knowledge Graph
DevOps
CI/CD
Git
GitHub
Analytics
Power BI
ETL/ELT
Dimensional Modeling
Management
Agile
Apply
$138k – $256k per year · Equity · Hybrid · Full-Time · 5+ years exp · New York · Frisco · Toronto · Ann Arbor
AI/ML
AI Agents
DevOps
CI/CD
Apply
Data Scientist 1 month ago
≈ $19k – $41k per year (Estimated) · In office · 8+ years exp · Pune
Python
SQL
Databases
Google BigQuery
AI/ML
Hadoop
Spark
Amazon SageMaker
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Analytics
Tableau
Power BI
Seaborn
Matplotlib
ETL/ELT
A/B Testing
Azure Data Factory
AWS Glue
Apply
AI Engineer 3 months ago
≈ $24k – $49k per year (Estimated) · In office · 5+ years exp · Bengaluru
AI/ML
Copilot
Model Context Protocol
AI Agents
LLM
Human-in-the-Loop
LLM Guardrails
Agentic Workflows
Machine Learning
DevOps
IAM
Management
ServiceNow
ITSM
Apply
In office · Full-Time · Hyderabad
Life Sciences
Veeva
Apply
In office · Full-Time · 2+ years exp · Hyderabad
JavaScript
Frontend
Web Components
Design
Figma
Life Sciences
Veeva
Apply
Account Manager 1 day ago
In office · Full-Time · PhD · Hyderabad
Apply
In office · 4+ years exp · Chennai · Hyderabad
Python
AI/ML
Copilot
Machine Learning
DevOps
Splunk
Ansible
Zabbix
CI/CD
IAM
Windows
DNS
VPN
Wi-Fi
Cybersecurity
ISO 27001
CIS Benchmarks
Zero Trust
Apply
Remote (India) · Full-Time · 8+ years exp · Hyderabad
Python
JavaScript
TypeScript
SQL
Python
FastAPI
AI/ML
AutoGen
AI Agents
LLM
Frontend
Angular
React.js
DevOps
Rest API
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
See all jobs
This is one of many
2,385,015 more open roles from verified company boards, updated every day.