2,296,273open jobs
145,786companies
269,851added this week
Browse all
Location
In office (Pune)
Seniority
Senior · 6+ years exp

First seen by Alion on Nov 16, 2026.

Overview
Company
Impact
Profile match
Asrah Technologies India Limited Asrah Technologies India Limited is a public limited company registered under the companies act 1956. We are Technology & Process driven service organization based at Bangalore. Through our shared values, we provide a comp.

Job Summary:

We are looking for a Senior Data Engineer to design, build, and operate our enterprise data platform on Azure and Databricks, with strong hands-on skills in GenAI/LLM application engineering. This role owns the full lifecycle of data pipelines and AI-powered applications from ingestion and orchestration to governance, API development, and deployment.

Key Responsibilities:

GenAI & LLM Application Engineering:

- Design and build RAG pipelines, including embedding-based and graph/metadata-grounded retrieval approaches.

- Orchestrate multi-step and multi-agent LLM workflows using LangGraph and LangChain.

- Build and integrate tools/agents using MCP for structured tool-calling and context management.

- Develop backend APIs for AI applications using FastAPI and Python Flask.

- Build and manage LLM/agent workflows using Azure AI Foundry, and implement semantic + vector search using Azure AI Search indexes.

- Implement prompt engineering, structured outputs, guardrails, and LLM evaluation/observability practices.

Data Engineering & Pipeline Development:

- Design and build scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark, Spark SQL).

- Develop and maintain Databricks Lakeflow (Delta Live Tables) pipelines across bronze/silver/gold medallion layers.

- Use Databricks Autoloader for incremental, schema-evolving file ingestion into Delta Lake.

- Build reusable, config-driven ingestion frameworks supporting multiple heterogeneous source systems.

- Implement CDC, SCD Type 1/2, and incremental loading strategies.

- Package and deploy Databricks workflows using Databricks Asset Bundles (DABs).

Platform, Infrastructure & DevOps:

- Own infrastructure provisioning and deployment using Terraform for Databricks, ADF, and related Azure resources.

- Build and maintain Azure DevOps CI/CD pipelines for automated testing, deployment, and release management.

- Deploy and manage applications on Azure Container Apps, using Docker for containerization.

- Develop and support Databricks Apps for internal data tooling.

Governance, Security & Reliability:

- Implement and maintain data governance using Databricks Unity Catalog.

- Design and enforce security policies across managed tables.

- Build monitoring, alerting, and SLA dashboards to ensure pipeline reliability and data quality.

- Perform Spark/Databricks performance tuning, cluster sizing, partitioning, and cost optimization.

Collaboration:

- Partner with data architects, analysts, and business stakeholders to translate requirements into scalable data and AI solutions.

- Document architecture, pipelines, and operational runbooks.

- Mentor junior engineers on Databricks, Python development, and platform engineering best practices.

Preferred Candidate Profile:

- Strong hands-on experience with Azure Data Factory, Databricks (PySpark, Spark SQL, Delta Lake, Autoloader, Lakeflow, DABs), and Unity Catalog.

- Proficiency in Databricks Apps, Azure Container Apps, Docker, and Terraform.

- Strong Python development skills, including API development with FastAPI and Flask.

- Hands-on experience with LLM application engineering (RAG, LangGraph, LangChain, MCP).

- Experience with Azure AI Foundry, Azure AI Search, and vector databases.

- Experience with CI/CD using Azure DevOps and API integration.

Skills

Data Engineering, Generative AI, Databricks, Python, Azure, LLM, PySpark, Terraform, LangChain, FastAPI

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,296,273 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
Pune
In office · 10+ years exp · Chennai
Databases
Snowflake
AI/ML
Streamlit
LLMOps
LLM Guardrails
DevOps
Terraform
GCP
Prometheus
Azure
AWS
Cortex
FinOps
Apply
In office · 3+ years exp · Gurgaon
Python
Python
FastAPI
Django
Asyncio
Celery
AI/ML
Model Context Protocol
Function Calling
AI Agents
LLM
Structured Outputs
Computer Use
Machine Learning
DevOps
CI/CD
AWS
Amazon ECS
Amazon CloudWatch
QA
Playwright
Apply
In office · Full-Time · 5+ years exp · Pune · Bengaluru
Python
Java
Python
FastAPI
Databases
Amazon Aurora
AI/ML
LangGraph
LangChain
Model Context Protocol
vLLM
Prompt Engineering
AI Agents
AWS Bedrock
LLM
RAG
Google ADK
A2A
LLM Guardrails
NIST AI RMF
Frontend
WebAssembly
DevOps
Istio
CloudFormation
Envoy
AWS
Kubernetes
Service Mesh
Amazon EKS
IAM
Cybersecurity
OWASP
Apply
Hybrid · Full-Time · 3+ years exp · Bachelor's Degree · Hyderabad
Python
AI/ML
MLFlow
AI Agents
NLP
Arize Phoenix
DeepEval
Langfuse
LangSmith
Promptfoo
Ragas
LLM
RAG
TruLens
OpenAI Evals
Braintrust
Galileo
Giskard
Red Teaming
Machine Learning
DevOps
Azure
AWS
Apply
Hybrid · Full-Time · 7+ years exp · Bachelor's Degree · Hyderabad
Python
AI/ML
MLFlow
AI Agents
NLP
Arize Phoenix
DeepEval
Langfuse
LangSmith
Promptfoo
Ragas
LLM
RAG
TruLens
OpenAI Evals
Braintrust
Galileo
Giskard
Red Teaming
Machine Learning
DevOps
Azure
AWS
Apply
≈ $20k – $42k per year (Estimated) · Hybrid · 6+ years exp · Pune
Python
JavaScript
Java
TypeScript
Python
Flask
FastAPI
Django
Java
Spring Boot
AI/ML
LangGraph
LangChain
Embeddings
Prompt Engineering
AI Agents
LLM
RAG
LLMOps
AWS Strands Agents
Semantic Search
LLM Guardrails
Frontend
Angular
React.js
DevOps
Rest API
CI/CD
AWS
Docker
Kubernetes
Apply
Hybrid · 6+ years exp · Master's Degree · Pune
Python
Java
SQL
C++
DevOps
Rest API
Analytics
ETL/ELT
Master Data Management
Apply
≈ $24k – $51k per year (Estimated) · Hybrid · 10+ years exp · Bachelor's Degree · Pune
Java
DevOps
Azure DevOps
Azure
Management
Confluence
Jira
Agile
Scrum
Apply
≈ $19k – $40k per year (Estimated) · Hybrid · 8+ years exp · Pune
AI/ML
Gemini
RAG
Multi-Agent Systems
DevOps
Terraform
GCP
Kubernetes
Google GKE
IAM
Cybersecurity
Threat Modeling
SIEM
Apply
≈ $19k – $41k per year (Estimated) · Hybrid · 6+ years exp · Pune
Python
SQL
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
AI/ML
Spark
DevOps
Azure DevOps
Azure
CI/CD
Git
Analytics
ETL/ELT
Azure Data Factory
Dimensional Modeling
Management
Agile
Apply
See all jobs
This is one of many
2,296,273 more open roles from verified company boards, updated every day.