Data Engineer - Python, Pyspark, ETL - Malaysia Locals
Smart Apply
Similar jobs
Location
In office (Malaysia)
Experience
3+ years exp
Employment
Full-Time
First seen by Alion on Nov 11, 2026.
Overview
Company
Impact
Profile match
Role Summary:
- Responsible for data mapping, designing, development, testing, implementing for Enterprise Data Lake
- Data Pipelines (Bronze, Silver, and Gold) data delivery within timeline.
- Documentation required: on Data Mapping, Technical Specification, and SIT plan & test cases and technical specification
- Model Design: Designing schemas for warehouses and analytical model concept for implementation.
- Development of Automated Workflows: Design, build, and maintain ETL/ELT pipelines (end-to-end) from sourcing to final data product delivery for structured and unstructured data
- Data Preparation: Cleaning and preprocessing data to make it suitable for analysis, implementing data transformation processes to extract data for the creation and loading of Data Products. Provide strategic recommendations that enhance productivity and business performance
- Data Integration: Integrate data from multiple sources into centralized platforms for analytics and reporting. API data integration to EDL pipelines with Internal and External applications. Kafka included for real time streaming.
- Data Quality: Building frameworks/program for validation, monitoring, and error handling
- Batch Scheduling: Nifi, Airflows, etc.
- Data Model Implementation: Apache Iceburg framework for SCD data model
- Scripting & Automation: Proficiency in Python, Powershell, YAML, bash, and etc.
- OS Knowledge: Strong proficiency in Linux systems and networking for integration and ELK stack management.
- Big Data & Kafka: Familiar with data streaming technologies such as Kafka
- Minimum 3 to 5 years of relevant experience in Data Engineering fields and good knowledge of Data Warehousing/Data Lake modeling and implementation.
- Good Problem solving skill.
- Bachelor's/ Master Degree: In Engineering, Computer Science, IT, or related technical field
- Data Engineering Certification
- Familiarity with data modeling and ETL concepts.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,243,256 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Malaysia
In office · Full-Time · 5+ years exp · Bachelor's Degree · Malaysia
SQL
Analytics
Tableau
Power BI
Management
ITIL
ITSM
Apply
数据开发
8 hours ago
$14k – $25k per year · In office · Full-Time · Nanjing
SQL
DevOps
Git
Analytics
ETL/ELT
Life Sciences
LIMS
Apply
Senior Data Scientist
1 day ago
$113k – $183k per year · In office · Full-Time · 5+ years exp · Bachelor's Degree · Irving
Python
SQL
AI/ML
AI Agents
Machine Learning
Apply
Reference Data Operations Specialist
1 hour ago
In office · 5+ years exp · Miami
SQL
Analytics
Microsoft Excel
Apply
Apply
Senior Python Developer – Generative AI
10 hours ago
In office · Full-Time · 3+ years exp · Malaysia
Python
AI/ML
Claude
Prompt Engineering
LLM
DevOps
AWS
Apply
PHP WordPress Developer
10 hours ago
In office · Full-Time · 2+ years exp · Malaysia
Python
JavaScript
PHP
TypeScript
SQL
Python
Django
PHP
WordPress
Databases
MySQL
Frontend
Angular
Management
Agile
Scrum
Apply
In office · Kuala Lumpur
DevOps
Incident Management
Management
ITIL
Apply
Apply
AVP, Team Lead, Account Closure
1 day ago
≈ $18k – $46k per year (Estimated) · In office · Full-Time · Malaysia
Apply
This is one of many
2,243,256 more open roles from verified company boards, updated every day.