Data Engineer

Job summary :

We are looking for an experienced Data Engineer - OCI Data Lakehouse (DLH) to join our Data Management Office and support enterprise-scale Oracle Cloud Infrastructure (OCI) Data Engineering and Data Lakehouse projects.

The ideal candidate will have strong hands-on experience in OCI Data Flow, Apache Spark, Oracle Autonomous Data Warehouse (ADW), OCI Object Storage, Oracle Data Integrator (ODI), Python, SQL, and Delta Lakehouse architecture.

The role will involve designing and developing scalable data pipelines, data ingestion frameworks, analytical datasets, and data products supporting business analytics, regulatory reporting, and AI/ML initiatives.

Key Responsibilities :

- Design, develop, and maintain scalable OCI data pipelines for data ingestion, transformation, and processing.

- Build ETL/ELT workflows using OCI Data Flow, Apache Spark, ODI, and AIDP.

- Implement Data Lakehouse and Delta Lake architectures, including ingestion, curation, and consumption layers.

- Develop and optimize analytical datasets, data marts, and data models on Oracle Autonomous Data Warehouse (ADW).

- Manage structured and unstructured data within OCI Object Storage.

- Develop reusable data ingestion and transformation frameworks.

- Implement data quality, metadata, lineage, governance, and validation controls.

- Optimize SQL queries, Spark jobs, ETL processes, and ADW workloads.

- Identify and resolve data pipeline, performance, and processing bottlenecks.

- Work closely with business and technology stakeholders to convert requirements into scalable data solutions.

- Support data products for analytics, reporting, regulatory requirements, and AI/ML use cases.

Required Skills & Experience:

- OCI & Oracle Technologies: Strong hands-on experience with Oracle Cloud Infrastructure (OCI), OCI Data Flow / Apache Spark, Oracle Autonomous Data Warehouse (ADW), OCI Object Storage, Oracle Data Integrator (ODI), Oracle AI Data Platform (AIDP).

- Data Engineering: 7+ years of relevant experience, strong proficiency in SQL and Python, experience developing enterprise-scale ETL/ELT pipelines, knowledge of data ingestion, transformation, orchestration, and processing, experience with Apache Spark / PySpark, Delta Lakehouse, Medallion Architecture, and data performance tuning.

Preferred Skills:

- Oracle GoldenGate, Real-time data replication and Change Data Capture (CDC), Data governance and metadata management, Data lineage and data quality frameworks, Data observability, AI/ML data preparation and feature engineering, Experience with enterprise cloud data platforms.

Domain Experience:

- Experience in the Insurance industry is preferred but not mandatory. Exposure to Policy Administration, Claims Management, Underwriting, Finance, or Regulatory Reporting will be an advantage.

Key Performance Targets:

- Build reliable and scalable OCI data pipelines.

- Improve data processing performance and platform efficiency.

- Develop reusable ingestion and transformation frameworks.

- Deliver trusted, high-quality analytical datasets.

- Support timely delivery of business and regulatory data requirements.

- Improve data availability for analytics and AI/ML initiatives.

- Maintain strong data quality, lineage, governance, and operational reliability.

Ideal Candidate:

- We are specifically targeting hands-on Data Engineers with strong experience in: OCI + Data Flow + Spark/PySpark + Python + SQL + ADW + ODI + Delta Lakehouse. This is a Data Engineering / Data Lakehouse role, not an Oracle DBA or general OCI Infrastructure Administrator position.

Skills

Data Engineering, Oracle Cloud Infrastructure, DataLake, Python, SQL, ETL, PySpark