Easy applyno account needed
Senior Data Engineer (Databricks and Pyspark)-Mandarin Speaker
Smart Apply
Similar jobs
Location
In office (Kuala Lumpur)
Seniority
Senior
Employment
Full-Time
Confirmed on the employer's own hiring board on Nov 11, 2026. First seen by Alion on Nov 5, 2026. Unison Group scores B on the Alion truth index.
Overview
Company
Impact
Profile match
Unison Group is an IT consulting and services firm headquartered in Singapore that works mainly for banks and other financial institutions. It provides cloud engineering, data analytics and business intelligence, risk and regulatory compliance and system modernisation services, with consultants frequently placed on client projects. It hires Qlik developers and architects, Google Cloud engineers and contract specialists in Singapore, Kuala Lumpur, Hyderabad and Bengaluru.
Position : Senior Data Engineer.
Location : Malaysia and Singapore.
Language : Mandarin Language must.
Role : Full Time Perm role + one month Bonus.
Requirements
We are looking for a Senior Data Engineer with strong expertise in Databricks, PySpark, Delta Lake, and cloud-based data pipelines. implement Lakehouse/Medallion architectures, and integrate data from multiple internal and external systems. This role requires strong technical leadership and hands-on architecture experience.
Key Responsibilities
- Design, build, and optimize data ingestion and transformation pipelines using Databricks, PySpark, and Python.
- Implement Delta Lake and Medallion architecture for scalable enterprise data platforms.
- Develop ingestion frameworks for data from SFTP, REST APIs, SharePoint/Graph API, AWS, and Azure sources.
- Automate workflows using Databricks Workflows, ADF, Azure Functions, and CI/CD pipelines.
- Optimize Spark jobs for performance, reliability, and cost efficiency.
- Implement data validation, quality checks, and monitoring with automated alerts and retries.
- Design secure and governed datasets using Unity Catalog and cloud security best practices.
- Collaborate with analysts, business users, and cross-functional teams to deliver curated datasets for reporting and analytics.
- Provide technical leadership and guidance to junior team members.
Required Skills
- 5-8+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks, PySpark, Delta Lake, SQL, Python.
- Experience with Azure Data Lake, ADF, Azure Functions, or AWS equivalents (S3, Lambda).
- Experience integrating data from APIs, SFTP servers, vendor data providers, and cloud storage.
- Knowledge of ETL/ELT concepts, Lakehouse/Meddalion architecture, and distributed processing.
- Strong experience with Git, Azure DevOps CI/CD, and YAML pipelines.
- Ability to optimize Spark workloads (partitioning, caching, Z-ordering, performance tuning).
Good to Have
- Exposure to Oil & Gas or trading analytics (SPARTA, KPLER, IIR, OPEC).
- Knowledge of Power BI or data visualization concepts.
- Familiarity with Terraform, Scala, or PostgreSQL.
- Experience with SharePoint development or .NET (optional)
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,175,720 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Kuala Lumpur
Senior Data Engineer
8 hours ago
Hybrid · Full-Time · 8+ years exp · Kuala Lumpur
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
DevOps
CI/CD
Git
AWS
Amazon S3
IAM
Apply
$4.4k – $19k per year (gross) · In office · Internship · Petaling Jaya
Analytics
Microsoft Excel
Management
ServiceNow
Apply
Cloud Data Architect
2 days ago
$154k – $278k per year · Remote (United States, ET hours) · Full-Time · 15+ years exp · Bachelor's Degree · Washington
Databases
Databricks
Delta Lake
Apache Kafka
DevOps
Azure
Platform Engineering
Cybersecurity
NIST 800-53
Zero Trust
Analytics
Azure Data Factory
Collibra
Apply
Data Engineer
2 hours ago
Remote (United States) · Full-Time · 3+ years exp · Alpharetta
Python
SQL
Databases
Snowflake
AI/ML
dbt
Analytics
Fivetran
Apply
$120k – $180k per year · Remote (United States) · 6+ years exp · PhD
Python
Java
SQL
PowerShell
Databases
Oracle
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Jenkins
Git
AWS
Analytics
ETL/ELT
Dimensional Modeling
Management
Agile
Scrum
Apply
Senior Software Engineer
5 days ago
Remote (India) · Full-Time · 6+ years exp · Bachelor's Degree · Bengaluru
Python
Java
SQL
Scala
Python
pySpark
Databases
HBase
Cassandra
Apache Kafka
AI/ML
Hadoop
Spark
Airflow
Machine Learning
DevOps
Git
Linux
Unix
Analytics
ETL/ELT
Apache NiFi
Apply
Apply
Devоps Team Lead
5 days ago
Remote (EAEU) · Saint Petersburg
Python
Databases
MySQL
PostgreSQL
ClickHouse
Aerospike
DevOps
Ansible
CI/CD
ArgoCD
Kubernetes
Nginx
GitLab
Linux
Apply
Data Scientist
6 days ago
In office · Bachelor's Degree · Gurgaon
Python
AI/ML
Time Series
Machine Learning
DevOps
Azure
Analytics
Power BI
Apply
Senior Data Engineer
29 days ago
≈ $16k – $41k per year (Estimated) · In office · Full-Time · Bachelor's Degree · Kuala Lumpur
Python
SQL
Scala
Databases
Databricks
Delta Lake
AI/ML
Spark
MLFlow
LLM
DevOps
Splunk
Terraform
GCP
Prometheus
Azure
CI/CD
Git
AWS
Amazon CloudWatch
Analytics
ETL/ELT
Apply
Data Architect(Databricks Practice)
29 days ago
≈ $21k – $51k per year (Estimated) · In office · Full-Time · Bachelor's Degree · Kuala Lumpur
Python
SQL
Scala
Databases
Databricks
Delta Lake
Microsoft Fabric
AI/ML
Hadoop
Spark
MLFlow
LLM
OpenAI
Anthropic
DevOps
GCP
Azure
CI/CD
AWS
Analytics
ETL/ELT
Apply
Senior Informatica Consultant / Data Analyst Lead
5 months ago
≈ $20k – $45k per year (Estimated) · In office · Full-Time · Bachelor's Degree · Kuala Lumpur
SQL
Databases
Oracle
Teradata
AI/ML
Hadoop
DevOps
CI/CD
Jenkins
Bitbucket
Incident Management
Analytics
ETL/ELT
Informatica
Management
Agile
Apply
Big Data Hadoop Developer
1 year ago
In office · Full-Time · Bachelor's Degree · Kuala Lumpur
Python
Java
SQL
Scala
Databases
Oracle
HBase
Cassandra
MariaDB
Apache Kafka
AI/ML
Hadoop
Spark
Machine Learning
DevOps
GCP
Azure
Jenkins
Git
AWS
Linux
Unix
Analytics
ETL/ELT
Apache NiFi
Apply
Data Scientist - Manufacturing Analytics
23 days ago
≈ $48k – $117k per year (Estimated) · In office · Contractor · Bachelor's Degree · Singapore
Python
SQL
AI/ML
Scikit-learn
Pandas
NumPy
Anomaly Detection
Time Series
Machine Learning
DevOps
GCP
Azure
AWS
Analytics
ETL/ELT
Apply
Senior Data Engineer
8 hours ago
Hybrid · Full-Time · 8+ years exp · Kuala Lumpur
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
DevOps
CI/CD
Git
AWS
Amazon S3
IAM
Apply
Data Scientist - Credit Risk
8 hours ago
In office · Full-Time · Bachelor's Degree · Kuala Lumpur · Jakarta
Python
SQL
AI/ML
Scikit-learn
Machine Learning
Apply
Business Analysis
4 hours ago
In office · Full-Time · Kuala Lumpur
Python
SQL
Databases
Snowflake
AI/ML
AI Agents
Machine Learning
Analytics
Power BI
Management
Confluence
Jira
UiPath
Power Automate
Agile
Scrum
Apply
Head, VCC CoSec, Risk Management & Governance
5 hours ago
In office · Full-Time · 12+ years exp · Bachelor's Degree · Kuala Lumpur · Bengaluru
Apply
VCC Transitions Lead
5 hours ago
In office · Full-Time · Bachelor's Degree · Kuala Lumpur · Bengaluru
Management
ITIL
Apply
This is one of many
2,175,720 more open roles from verified company boards, updated every day.