Data Engineer (Expert)

Imizizi · On-call duty · Python · JavaScript · Java · TypeScript · ETL/ELT · 2 days ago
Smart Apply
Similar jobs
2,136,955open jobs
135,735companies
252,120added this week
Browse all
Location
In office (Pretoria)
Seniority
Senior · 6+ years exp
Employment
Full-Time

First seen by Alion on Nov 5, 2026.

Overview
Company
Impact
Profile match

Imizizi

About Imizizi Diversity and growth at our core Imizizi, from mizizi, the Swahili word for "root", is 100% Black female-owned. It was founded on a deeply rooted passion for people, skills development, and service delivery.
imizizi.co.za · HQ: Pretoria, South Africa
Tech stack of Imizizi
Reference: JHB001567-KF-2

ESSENTIAL SKILLS:


  • Hands-on experience with Kafka and event streaming platforms for real-time data movement.

  • Proven experience with API integration patterns, webhooks and event/webhook ingestion.

  • Strong proficiency in Python for data engineering, ingestion pipelines and automation.

  • Solid competence with enterprise databases and query languages, with practical experience with database performance tuning and query optimisation for OLTP/operational workloads.

  • Experience in data modelling to design schemas and standardized data representations.

  • Experience with schema registries and contract-first designs (Avro, Protobuf) to manage producer/consumer compatibility.

  • Strong understanding and practice of data quality techniques and tooling to ensure trusted data.

  • Knowledge of metadata management and cataloguing to support discoverability and lineage.

  • Familiarity with ETL/ELT patterns and best practices for performant, reliable data pipelines.

  • Ability to normalise and correlate data across multiple sources (CMDB, identity, security tooling).

  • Design and operate idempotent pipelines with retry, replay and compensation mechanisms.


ADVANTAGEOUS SKILLS:


  • Experience with Java for stream processing or connector development.

  • Awareness of frontend frameworks (e.g., Angular) to better understand downstream consumers.

  • Familiarity with infrastructure automation and IaC (e.g., Terraform) to deploy integration components.

  • Experience operating container platforms and orchestration (Kubernetes) for scalable stream processing.

  • Experience with NoSQL/document stores such as MongoDB for operational data needs.

  • Familiarity with enterprise systems like SAP and working with their integration interfaces.

  • Experience with big data ecosystems (CDH/Hadoop) and distributed storage/processing.

  • Working knowledge of Azure Synapse or similar data platform services for integrated data processing.

  • Observability for streaming: experience with metrics, tracing and logging for pipelines (Prometheus, Grafana, OpenTelemetry).

  • Experience with connector ecosystems and managed services (Kafka Connect, Confluent Cloud, managed Kafka).

  • Knowledge of message delivery semantics, partitioning strategies and capacity planning for high-throughput pipelines.

Duties & Responsibilities ROLE & RESPONSIBILITIES:
  • Design, build and operate operational data integration solutions focused on making enterprise data available, trusted and consumable.
  • Ingest and stream data from Zero Trust data sources (CMDB, identity systems, security tooling) into operational pipelines rather than analytics stores.
  • Build and maintain Kafka topics, producers/consumers, connectors and streaming applications to enable realtime flows.
  • Implement API-based integrations, webhook listeners and file ingestion solutions to capture operational events.
  • Develop robust ETL/ELT and stream processing logic to normalise, correlate and enrich data across sources.
  • Ensure pipelines are idempotent and resilient (retries, replay, backpressure and compensation strategies).
  • Apply data modelling and metadata practices to ensure consistent schemas and discoverability.
  • Implement and monitor data quality checks, anomaly detection and validation rules; drive remediation where needed.
  • Maintain data lineage, access control and security practices to meet governance and compliance requirements.
  • Collaborate with automation and orchestration teams to ensure streamed operational data feeds automation workflows and runbooks.
  • Own pipeline alerting, runbooks, and participate in incident response/on-call rotations
  • Troubleshoot production issues, perform root cause analysis and implement long-term reliability improvements.
  • Build testable pipelines with unit/integration tests, contract tests and CI/CD deployment pipelines for streaming workloads
  • Data Quality Gates: enforce automated quality checks early in pipelines (validation, schema checks, anomaly detection) and block or quarantine bad data.
  • Performance & Cost Awareness: implement efficient partitioning, batching and resource usage patterns while tracking cost and throughput trade-offs.
  • Security & Privacy by Design: apply least-privilege, secrets management, encryption in transit and at rest, and data masking/anonymisation where required.
  • Drive architectural decisions and define integration best practices
QUALIFICATIONS/EXPERIENCE:
  • Extensive hands-on experience (typically 6+ years) in data engineering, integration or streaming roles with demonstrable production experience.
  • Proven track record building and operating streaming platforms (Kafka) and API-based integrations, with strong Python/Java and enterprise databases and query languages skills.
  • Strong analytical thinking, curiosity about data, attention to detail, structured problem solving and ownership - able to figure things out and drive topics to completion.
Submit your CV to: [email protected] and Subject line Role title
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,136,955 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Pretoria
Senior Data Engineer 11 days ago
Hybrid · Full-Time · Cape Town
SQL
Databases
MS SQL
Azure SQL Database
Microsoft Fabric
AI/ML
dbt
DevOps
Azure DevOps
Azure
CI/CD
Git
Analytics
Tableau
Power BI
ETL/ELT
Informatica
SSIS
Azure Data Factory
Dimensional Modeling
Apply
SENIOR DATA SCIENTIST 10 hours ago
In office · 4+ years exp · Bachelor's Degree · Pretoria
DevOps
Incident Management
Wi-Fi
Apply
In office · Full-Time · Sandton
Python
C#
Python
pySpark
C#
.NET
Databases
Databricks
Azure Cosmos DB
Azure SQL Database
AI/ML
Spark
Machine Learning
DevOps
Terraform
Azure DevOps
Azure
Cybersecurity
GDPR
Analytics
Power BI
ETL/ELT
Azure Data Factory
Dimensional Modeling
Master Data Management
Management
Power Automate
Power Apps
SharePoint
Apply
In office · Full-Time · Pretoria
Python
JavaScript
Java
TypeScript
Databases
Apache Kafka
AI/ML
Hadoop
Frontend
Angular
DevOps
Terraform
OpenTelemetry
Prometheus
Azure
Kubernetes
Grafana
Cybersecurity
Zero Trust
Least Privilege
Analytics
ETL/ELT
Apply
In office · Full-Time · Durban
Python
SQL
PowerShell
Databases
PostgreSQL
Apache Kafka
AI/ML
Airflow
DevOps
Windows Server
Windows
Analytics
ETL/ELT
Apply
In office · 5+ years exp · Petaling Jaya
Python
JavaScript
Node JS
AI/ML
Claude
Embeddings
Prompt Engineering
LLM
RAG
OpenAI
Frontend
Next.js
React.js
Apply
Equity · Hybrid · 6+ years exp · Wellington
Python
JavaScript
TypeScript
SQL
C#
AI/ML
Copilot
Cursor
Claude Code
DevOps
CI/CD
AWS
Windows
QA
Cypress
Playwright
Postman
Pact
Apply
Equity · Hybrid · 6+ years exp · Auckland
Python
JavaScript
TypeScript
SQL
C#
AI/ML
Copilot
Cursor
Claude Code
DevOps
CI/CD
AWS
Windows
QA
Cypress
Playwright
Postman
Pact
Apply
Equity · Hybrid · 6+ years exp · Christchurch
Python
JavaScript
TypeScript
SQL
C#
AI/ML
Copilot
Cursor
Claude Code
DevOps
CI/CD
AWS
Windows
QA
Cypress
Playwright
Postman
Pact
Apply
Equity · Hybrid · 6+ years exp · Auckland
Go
Java
Kotlin
SQL
C#
C#
.NET
Databases
Redis
DynamoDB
Memcached
AI/ML
Copilot
Cursor
Claude Code
DevOps
CI/CD
AWS
AWS Lambda
Amazon S3
Amazon ECS
Management
Confluence
Jira
QA
Postman
Apply
In office · Full-Time · Pretoria
Python
JavaScript
Java
TypeScript
Databases
Apache Kafka
AI/ML
Hadoop
Frontend
Angular
DevOps
Terraform
OpenTelemetry
Prometheus
Azure
Kubernetes
Grafana
Cybersecurity
Zero Trust
Least Privilege
Analytics
ETL/ELT
Apply
In office · Full-Time · 10+ years exp · Pretoria
Java
COBOL
Java
Maven
Quarkus
Databases
Db2
Apache Kafka
IMS
DevOps
Terraform
OpenShift
CloudFormation
CI/CD
Git
AWS
Docker
Kubernetes
AWS Lambda
Amazon S3
Linux
Unix
Management
Agile
Apply
In office · Full-Time · 8+ years exp · Pretoria
Java
SQL
Java
Spring Framework
Databases
PostgreSQL
DevOps
Rest API
GitHub Actions
GitLab CI
CI/CD
Jenkins
Git
AWS
Docker
Kubernetes
Cybersecurity
SonarQube
Management
Agile
Apply
In office · Full-Time · Pretoria
C#
C#
.NET
AI/ML
Model Context Protocol
Function Calling
AI Agents
Semantic Kernel
LLM
OpenAI
A2A
Human-in-the-Loop
Structured Outputs
DevOps
Rest API
Azure
CI/CD
Git
Docker
Kubernetes
Azure AKS
Management
Agile
Apply
In office · Full-Time · 6+ years exp · Pretoria
ABAP
ABAP
SAP Fiori
Management
Confluence
Agile
Apply
Warehouse Manager 1 day ago
In office · 3+ years exp · Pretoria
Apply
In office · 3+ years exp · Pretoria
Apply
In office · 3+ years exp · Pretoria
Apply
In office · Contractor · 3+ years exp · Pretoria
Apply
In office · Contractor · 5+ years exp · Pretoria
Apply
See all jobs
This is one of many
2,136,955 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles