Senior Databricks Engineer

Numentica Technologies • IT Consulting & Digital Transformation • Custom Software Development • Python • SQL • ETL/ELT • Azure Data Factory • AWS Glue • 6 days ago
Smart Apply
Similar jobs
1,979,292open jobs
116,735companies
253,610added this week
Browse all
Location
In office
Seniority
Senior · 7+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 25, 2026. First seen by Alion on Oct 20, 2026.

Overview
Company
Impact
Profile match

Numentica Technologies

Numentica Technologies is an Indian IT services and consulting company that supplies engineers and consultants to clients in the United States on contract terms. It hires frontend engineers, a chief technology officer, a vice president of technology, Salesforce and Amazon Connect consultants and IT administrators. The company is based in Chennai, India.
numentica.com • HQ: Chennai, India • IT Staffing & Staff Augmentation • Custom Software Development • IT Consulting & Digital Transformation
Tech stack of Numentica Technologies

We are looking for a Senior Databricks Engineer with 7+ years of experience in data engineering and strong hands-on expertise in Databricks, Apache Spark, and Claude Agent. The ideal candidate will design and build scalable data pipelines, optimize large-scale data processing, work with cloud-based data platforms, and leverage Claude Agent for AI-powered data engineering and workflow automation.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
  • Develop and optimize PySpark/Spark jobs for large-scale data processing.
  • Build reliable ETL/ELT pipelines using Databricks workflows, Delta Lake, and SQL.
  • Implement data transformations, data quality checks, and performance optimization.
  • Work with cloud data platforms such as AWS, Azure, or GCP.
  • Optimize Spark jobs, cluster configurations, partitioning, joins, and data processing performance.
  • Design, develop, and integrate Claude Agent-based solutions for AI-powered data engineering, workflow automation, and intelligent data processing.
  • Collaborate with data engineers, data scientists, analysts, and business teams to deliver data solutions.
  • Implement best practices for CI/CD, version control, monitoring, and production support.
  • Troubleshoot data pipeline and performance issues in production environments.

Required Skills

  • 7+ years of experience in Data Engineering.
  • Strong hands-on experience with Databricks.
  • Strong expertise in Apache Spark / PySpark.
  • Experience with Delta Lake, Databricks Workflows, and Spark SQL.
  • Strong proficiency in Python and SQL.
  • Experience building and optimizing large-scale ETL/ELT pipelines.
  • Experience with at least one cloud platform: AWS, Azure, or GCP.
  • Good understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Git and CI/CD practices.

Preferred Skills

  • Experience with Unity Catalog and Databricks governance.
  • Experience with Azure Data Factory, AWS Glue, or similar orchestration tools.
  • Experience with Claude Agent / Claude-based AI agents for data engineering or workflow automation.
  • Knowledge of streaming technologies such as Kafka or Spark Structured Streaming.
  • Experience with Infrastructure as Code or cloud automation.
  • Databricks certifications are a plus.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,979,292 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
In your city
≈ $31k – $82k per year (Estimated) • In office • 7+ years exp • Bachelor's Degree • Abu Dhabi
Databases
Databricks
Azure SQL Database
Microsoft Fabric
DevOps
Azure
Analytics
Power BI
Azure Data Factory
Apply
$92k – $164k per year • Remote (United States) • 5+ years exp • Bachelor's Degree • United States
Python
Python
pySpark
Databases
Databricks
AI/ML
Copilot
Spark
AI Agents
DevOps
Azure
CI/CD
Git
Analytics
Azure Data Factory
Apply
≈ $116k – $229k per year (Estimated) • In office • 5+ years exp • Jersey City
Python
Java
Python
pySpark
Databases
Snowflake
Databricks
AI/ML
Spark
AI Agents
NLP
LLM
Human-in-the-Loop
DevOps
CI/CD
Apply
≈ $48k – $104k per year (Estimated) • Hybrid • Full-Time • 2+ years exp • Bachelor's Degree • Montreal • Mississauga
Python
Java
SQL
C++
C++
TensorFlow C++
Databases
Snowflake
Databricks
AI/ML
Model Context Protocol
AI Agents
TensorFlow
PyTorch
LLM
Machine Learning
DevOps
Rest API
Azure
Analytics
ETL/ELT
Apply
$185k – $258k per year • In office • Full-Time • 8+ years exp • Bachelor's Degree • Washington • Austin
Python
SQL
Databases
Snowflake
Google BigQuery
AI/ML
Claude
dbt
Analytics
Metabase
Looker
Apply
$11k per year (net) • In office • Samara
Python
PowerShell
Bash
Databases
PostgreSQL
MS SQL
DevOps
Zabbix
VMWare
Debian
Windows Server
Ubuntu
Proxmox VE
Linux
DNS
DHCP
VPN
VLAN
Management
Service Desk
Apply
≈ $20k – $50k per year (Estimated) • Remote (EAEU) • Full-Time • 2+ years exp • Moscow
SQL
C#
C#
ASP.NET Core
Entity Framework Core
Dapper
xUnit
Databases
PostgreSQL
Redis
ClickHouse
DevOps
CI/CD
Jenkins
Git
GitLab
Linux
Apply
In office • Full-Time • Bachelor's Degree • Bengaluru
SQL
Analytics
Tableau
Apply
Tester QA 1 day ago
Hybrid • Contractor • San Salvador
SQL
Management
Scrum
Apply
Hybrid • Contractor • San Salvador
Java
SQL
Management
Scrum
Kanban
QA
JMeter
Postman
Apply
≈ $129k – $256k per year (Estimated) • In office • Contractor • 8+ years exp • San Diego
Databases
PostgreSQL
Databricks
pgvector
Pinecone
Qdrant
Microsoft Fabric
DevOps
Azure
Analytics
Informatica
Azure Data Factory
Collibra
Alation
Apply
In office • Full-Time • 5+ years exp • Bachelor's Degree
DevOps
Wi-Fi
Apply
≈ $84k – $214k per year (Estimated) • Remote (location not specified, US time zones hours) • Contractor • 8+ years exp
JavaScript
Node JS
Node JS
Nest.JS
Databases
PostgreSQL
Apache Kafka
Amazon Aurora
Frontend
Next.js
React.js
DevOps
AWS
AWS Lambda
Apply
Remote (United States) • Contractor
DevOps
AWS
AWS Lambda
Apply
Automation Engineer 4 days ago
≈ $79k – $186k per year (Estimated) • Remote (location not specified) • Contractor • 5+ years exp
Python
JavaScript
TypeScript
C#
QA
Selenium
Playwright
Appium
Apply
See all jobs
This is one of many
1,979,292 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles