Data Platform Engineer - ANJU

Aspire Software is looking for a Data Platform Engineer to join our team in Lebanon.

Here is a little window into our company: Aspire Software operates and manages wholly owned software companies, providing mission-critical solutions across multiple verticals. By implementing industry best practices, Aspire delivers a time sensitive integration process, and the operation of a decentralized model has allowed it to become a hub for creating rapid growth by reinvesting in its portfolio.

About the job:

Data Platform Engineer will own the databases and data pipelines behind a data product with regular releases. The role combines database administration, scripting, integration and AI, in an agile Kanban team. You will fix data accuracy within life sciences and clinical trials raised by support and help deliver new product releases. Above all, you will improve the processes to deliver faster data updates through AI and Automation.

Core Responsibilities

Process Improvement

• Find bottlenecks, manual steps and recurring errors in the release process.
• Propose improvements, deliver them and measure the result.
• Automate repetitive steps with scripts (Python, SQL, Bash).
• Automate data health checks and functional tests.
• Run improvement projects and keep runbooks up to date.

Database Administration

• Administer, tune and monitor relational databases (MariaDB / MySQL, PostgreSQL, SQL Server or Oracle).
• Manage schemas, indexes, backups to S3, replication and user access.
• Run upgrades and migrations with minimal downtime.

Weekly Data Release

• Parse, map and load collected data from trial registries, publications, conferences and hospital directories.
• Run Java batch jobs, delta updates and production installs.
• Run queries, match and de-duplicate person and organisation records.
• Run mappers, publication pipelines and customer exports (API, S3, Azure).
• Hand each validated release to IT for provisioning, and support data checks after go-live.

Support and Product Releases

• Investigate and fix data issues raised by customers and support.
• Find the root cause so issues do not come back.
• Help plan and deliver new product releases and features.
• Prepare and validate the data changes for each new version.

Platform Operations

• Monitor data jobs and troubleshoot failures from logs and dashboards.
• Check job pods and logs on Kubernetes.

AI and Automation

• Use AI tools for data matching, classification, quality checks and coding.
• Use AI responsibly with personal and clinical data.

Agile Delivery (Kanban)

• Work from a Kanban board within WIP limits.
• Join stand-ups and retrospectives, and suggest ways to improve flow.

Requirements

• 3-5 years as a database administrator, database engineer or data engineer. Degree in Computer Science, Computer Engineering, Information Systems or similar.
• Experience working in an agile Kanban team, using Jira or similar.
• Clear written English.
• Works well to deadlines.

Strong Knowledge Of

• SQL and at least two relational databases (MariaDB / MySQL plus PostgreSQL, SQL Server or Oracle).
• Query tuning: execution plans, indexes and locking.
• Scripting in Python, SQL and Bash, plus Java; code kept in GitLab or Bitbucket.
• AI and data science: Python, statistics, machine learning basics and prompt design.
• Data analytics with SQL, pandas or Power BI.
• Kubernetes on AWS: pods, deployments, services and kubectl.
• Integration tools: Azure Functions, Azure Data Factory or similar.
• Backup, recovery and database security.

Personal Qualities

• Fast learner, curious and eager to grow.
• Positive, can-do attitude.
• Always looking for better ways of working.
• Team player who communicates clearly.
• Takes ownership and follows problems through to the fix.
• Strong attention to detail.
• Stays calm under deadlines.
• Supports and guides junior colleagues.

Preferred

• AWS: S3, EKS, Cognito and IAM.
• Azure: Azure and Databricks for analytics exports.
• AI and data science training: a diploma or courses in AI, data science or data analytics.
• Monitoring: ELK stack, Prometheus and Grafana.
• DevOps: Jenkins, Nexus, Helm and GitLab CI/CD for building and deploying data jobs.
• Clinical terminologies: MeSH or similar medical vocabularies.
• Agile certification: Kanban or Scrum.