2,370,762open jobs
148,355companies
290,119added this week
Browse all
Location
In office (Pune)
Seniority
Staff · 12+ years exp

First seen by Alion on Nov 18, 2026. Orbia scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Orbia is a Mexico City based industrial group that makes products for water management, building and infrastructure, data connectivity, polymers and fluorinated materials, formerly known as Mexichem. Its business groups include Wavin for building and infrastructure piping, Netafim for precision irrigation, Dura-Line for data communication conduit, Koura for fluor products and a polymer solutions arm, and the company reports over 22,000 employees with operations in more than 50 countries. Its openings cover extrusion operators, warehouse and shipping staff, customer service, technical sales, irrigation project sales, procurement, internal audit, HSE and engineering roles.

Key Responsibilities:

  • Main Purpose: The Lead Data Engineer - Databricks Data Analytics & Agent Bricks will be responsible for designing, building, governing, and operating enterprise-grade data engineering and AI-agent solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Delta Live Tables, Workflows, SQL Warehouses, MLflow, Model Serving) and Databricks Agent Bricks / Mosaic AI Agent Framework within Orbia's global Data, Analytics & AI landscape.
  • The role exists to ensure that data products, AI/BI dashboards, Genie spaces, RAG and Agent Bricks, and analytical workloads are designed using secure, scalable, compliant, cost-aware, and reusable engineering patterns aligned with Orbia's Lakehouse, governance, and Responsible AI standards.
  • The Lead Data Engineer will provide hands-on technical leadership to a team of data and analytics engineers, partner with business groups, platform owners, security, infrastructure, integration, governance, and external partners, and translate business and AI use cases into production-ready Databricks solutions.


Strategy & Planning:

  • Define and govern Databricks Lakehouse and Agent Bricks architecture principles, design standards, and reusable reference patterns for enterprise data and AI-agent solutions.
  • Design end-to-end data engineering patterns covering ingestion, bronze/silver/gold medallion architecture, Delta Live Tables, streaming, batch, and data product publishing on Unity Catalog.
  • Design Agent Bricks / Mosaic AI Agent Framework patterns for analytical agents, RAG applications, Genie spaces, AI/BI dashboards, and business assistants grounded on governed Lakehouse data.
  • Translate approved business and AI use cases into solution design documents, data contracts, platform-fit decisions, integration patterns, and production-readiness plans.
  • Define model and tool selection guidance covering accuracy, latency, cost (DBU/token), privacy, security, data sensitivity, and business purpose.
  • Establish engineering guardrails for prompt engineering, RAG grounding, tool calling, human-in-the-loop approvals, write-back controls, and auditability for Agent Bricks solutions.
  • Support Orbia AI/data governance, ARB submissions, decision records, architecture exceptions, and platform standards for Databricks solutions.
  • Partner with Data, Analytics & AI leadership to align Databricks engineering roadmap with Orbia's enablement strategy and scalable operating model.


Acquisition & Deployment:

  • Evaluate Databricks capabilities including Unity Catalog, Delta Live Tables, Workflows, SQL Warehouses, MLflow, Model Serving, Vector Search, Genie, AI/BI Dashboards, and Agent Bricks for enterprise fit.
  • Collaborate with cloud, infrastructure, network, security, integration, and AI architecture teams to design DEV / QA / PROD-ready deployment patterns using Databricks Asset Bundles and CI/CD.
  • Define secure ingestion and integration patterns from SAP, SharePoint, ServiceNow, Coupa, Salesforce, REST APIs, file shares, and event sources using Azure Data Factory, Auto Loader, and partner connectors.
  • Design API-led integration patterns using Azure API Management, Entra ID, OAuth, managed identity, service principals, and approved enterprise gateways for Databricks-hosted agents and endpoints.
  • Lead technical design reviews for data pipelines, Unity Catalog models, agent tools, vector indexes, model endpoints, evaluation workflows, monitoring, and release gates.
  • Build and review hands-on production-grade code in PySpark, Python, and SQL; enforce coding standards, peer reviews, unit/integration testing, and automated quality checks.
  • Support partner and vendor technical reviews to validate delivery approach, platform compatibility, security posture, and architecture compliance.


Operational Management:

  • Define operational runbooks for Databricks workspaces, Unity Catalog, jobs, DLT pipelines, Agent Bricks lifecycle, prompt/version control, evaluations, monitoring, telemetry, and incident support.
  • Ensure Databricks solutions follow least-privilege RBAC/ABAC, access reviews, environment segregation, audit logging, data protection, lineage, and Responsible AI controls.
  • Provide technical leadership, mentoring, and guidance to data engineers, analytics engineers, platform admins, business analysts, and implementation partners on approved design and implementation patterns.
  • Monitor and optimize solution design for DBU consumption, storage, SQL Warehouse usage, vector search cost, model endpoint usage, latency, quality, security, and scalability.
  • Review delivered solutions against engineering principles, Orbia governance expectations, SOX/ITGC controls, and production acceptance criteria before go-live.
  • Continuously improve Databricks engineering standards based on lessons learned, platform roadmap changes, business adoption, and operational feedback.
  • Lead and mentor a small team of data/analytics engineers; perform code reviews, sprint planning, capacity planning, performance feedback, and skill development.


Complexity of the Job:

  • Complexity of enterprise data and AI engineering across Databricks Lakehouse, Unity Catalog, Delta Live Tables, MLflow, Vector Search, Agent Bricks / Mosaic AI Agent Framework, Azure Data Factory, ADLS Gen2, APIM, Entra ID, Purview, SharePoint, SAP, ServiceNow, and Power BI.
  • Complexity of selecting the right delivery pattern across Databricks-led, Foundry-led, Copilot Studio, Power Platform, and hybrid Foundry + Databricks solutions.
  • Complexity of safely grounding analytical and agent answers using structured and unstructured enterprise data while maintaining data protection, lineage, citations, and auditability.
  • Complexity of GenAI and agent risks including hallucination, prompt misuse, sensitive data exposure, model and tool selection, cost escalation, and business process impact.
  • Complexity of supporting multiple business groups with diverse data sources, processes, and regional requirements.
  • Complexity of cost and performance optimization across DBU, storage, SQL Warehouses, model serving, and vector search while meeting SLAs and FinOps guardrails.
  • Collaboration with multiple global teams / departments for technical alignment and decision-making, such as Infrastructure, Network, Security, Enterprise Architecture, AI Architecture, Integration, Privacy, Compliance, and business groups.
  • Requirement to balance speed of data and AI experimentation with production readiness, lifecycle management, Responsible AI, FinOps, and enterprise governance (including SOX / ITGC).


Education, Experience, Language, & Physical Requirements:

  • Minimum 12-14 years of hands-on experience on the Databricks Lakehouse Platform including Apache Spark, PySpark, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Workflows, SQL Warehouses, MLflow, and Model Serving.
  • Minimum 2 years of hands-on or strong architecture experience with Databricks Agent Bricks / Mosaic AI Agent Framework, Vector Search, Genie spaces, AI/BI Dashboards, and RAG-based agentic applications grounded on Lakehouse data.
  • Strong programming skills in Python, PySpark, and advanced SQL; deep understanding of distributed computing, performance tuning, partitioning, Z-Ordering, file optimization, and Delta best practices.
  • Experience with CI/CD for Databricks using Databricks Asset Bundles, Azure DevOps and/or GitHub Actions, infrastructure-as-code (Terraform), and environment promotion patterns across DEV / QA / PROD.
  • Experience with the Azure data ecosystem including ADLS Gen2, Azure Data Factory, Azure Key Vault, Entra ID, Microsoft Purview, Azure Monitor, Azure API Management, and Azure OpenAI services.
  • Experience designing and operating ingestion pipelines from SAP (ECC/S4 HANA, BW, BTP), SharePoint, ServiceNow, Coupa, Salesforce, REST APIs, files, and streaming sources using Auto Loader, ADF, and partner connectors.
  • Experience designing RAG and agent solutions using SharePoint, enterprise documents, semantic indexes, embeddings, vector search, citations, chunking, grounding evidence, and answer evaluation.
  • Experience designing secure enterprise integrations using REST APIs, OAuth 2.0, managed identities, service principals, APIM, event-driven patterns, SAP BTP, ServiceNow APIs, or Microsoft Graph APIs.
  • Strong understanding of governance controls including Unity Catalog (catalogs/schemas/tables, row/column-level security, ABAC), RBAC, least privilege, segregation of duties, access reviews, private endpoints, audit logging, DLP, Purview, data classification, lineage, and SOX / ITGC expectations.
  • Experience in AI/data governance, Responsible AI, model and agent evaluation, prompt engineering, hallucination control, content safety, human approval gates, and production release criteria.
  • Demonstrated experience leading a team of data engineers / analytics engineers including hands-on technical leadership, mentoring, code reviews, sprint planning, and performance development.
  • Experience preparing architecture review documents, solution and low-level design documents, technical standards, operating procedures, decision records, and ARB-ready materials.
  • Strong understanding of cost management for Databricks and AI solutions including DBU usage, SQL Warehouse sizing, storage, vector search cost, model endpoints, monitoring, and FinOps guardrails.
  • Experience working in an international environment at a global company with cross-functional teams and business stakeholders across multiple regions.
  • Excellent communication skills in English, both verbally and in writing.
  • Capabilities to build trustworthy relationships with business users, platform teams, security, architecture, vendors, and implementation partners.
  • Self-starter with the ability to provide technical leadership, mobilize business partners, analyze requirements, challenge solution assumptions, push back when required, and remain result-oriented.
  • Physical requirements for the position such as mobility, vision, strength, etc. (applicable in line with local laws).

Skills

Apache Spark, Databricks, Delta Lake, MLflow, Mosaic AI, PySpark, RAG, Unity Catalog, Vector Search

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,370,762 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Similar stack
Same company
Pune
Remote (India) · 6+ years exp · Gurgaon · Bengaluru
Python
AI/ML
Model Context Protocol
Embeddings
Prompt Engineering
Function Calling
AI Agents
LLM
RAG
Structured Outputs
DevOps
Rest API
Management
n8n
Apply
Architect - Gen AI 2 hours ago
In office · Full-Time · 10+ years exp · Bachelor's Degree · Mumbai
Python
JavaScript
Databases
PostgreSQL
AI/ML
Claude
Grok
ElevenLabs
Fine-tuning
Scikit-learn
Ollama
TensorFlow
Keras
PyTorch
Gemini
LLM
RAG
Perplexity
OpenAI
Feature Store
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Apply
In office · Full-Time · Bachelor's Degree · Chennai
Python
C
C++
Bash
C
U-Boot
DevOps
Git
Linux
Management
Jira
Apply
Equity · In office · 10+ years exp · India
Databases
PostgreSQL
Milvus
pgvector
Pinecone
AI/ML
Copilot
Claude Code
LoRA
vLLM
Fine-tuning
Ollama
PEFT
QLoRA
TGI
LLM
RAG
Kong AI Gateway
Triton
LLMOps
LLM Evaluation
DevOps
Terraform
GitHub Actions
Envoy
Kong
CI/CD
GitOps
ArgoCD
Jenkins
AWS
Kubernetes
JFrog Artifactory
Amazon EKS
GitHub
API Gateway
Cybersecurity
Okta
SentinelOne
Apply
In office · 8+ years exp · Chennai
Python
JavaScript
TypeScript
Python
FastAPI
Databases
Neo4j
Databricks
AI/ML
Polars
Spark
Model Context Protocol
AI Agents
NLP
LLM
Knowledge Graph
LLM Guardrails
Frontend
React.js
DevOps
Rest API
Terraform
GCP
Helm
GitHub Actions
Azure
CI/CD
GitOps
AWS
Kubernetes
Bicep
API Gateway
Cybersecurity
Microsoft Entra ID
Apply
In office · 3+ years exp · Pune
Python
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Copilot
AutoGen
LangChain
Spark
LlamaIndex
Embeddings
Prompt Engineering
Function Calling
AI Agents
Semantic Kernel
LLM
RAG
Hallucination
Hybrid Search
OpenAI
Google AI Studio
GPT-4
Human-in-the-Loop
LLM Guardrails
Copilot Studio
DevOps
Terraform
Azure DevOps
GitHub Actions
Azure
CI/CD
Kubernetes
Bicep
Azure AKS
FinOps
Cybersecurity
Least Privilege
Microsoft Entra ID
DLP
Management
ServiceNow
SharePoint
Apply
Hybrid · 8+ years exp · Pune
Python
Python
Pydantic
AI/ML
LangGraph
LangChain
AI Agents
Human-in-the-Loop
Structured Outputs
LLM Guardrails
Multi-Agent Systems
DevOps
Rest API
CI/CD
Git
Platform Engineering
Management
Agile
Apply
In office · Full-Time · 12+ years exp · Bachelor's Degree · Pune
AI/ML
OpenAI
DevOps
Terraform
GCP
Azure
AWS
Kubernetes
Bicep
Azure AKS
Cybersecurity
MITRE ATT&CK
STRIDE
Least Privilege
Threat Modeling
Microsoft Entra ID
Apply
Senior Engineer 2 hours ago
In office · 3+ years exp · Pune
SQL
Apply
In office · Full-Time · Pune
Python
PowerShell
DevOps
Terraform
Azure DevOps
GitHub Actions
Dynatrace
Azure
CI/CD
GitOps
Kubernetes
Platform Engineering
Azure AKS
FinOps
Incident Management
Cybersecurity
Least Privilege
Microsoft Entra ID
Cryptography
Vault
MedTech
CAPA
Apply
See all jobs
This is one of many
2,370,762 more open roles from verified company boards, updated every day.