Senior Data Engineer

Responsibilities:

• Provide technical consultation and support to understand business complexities and IT requirements, translating them into actionable technology solutions.
• Advise management and recommend improvements to processes and procedures for greater efficiency and impact.
• Evaluate and select vendor-supplied hardware and software packages to best meet business needs.
• Support and uphold enterprise architecture and design standards.
• Engineer across multiple domains, such as DBMS (DB2 UDB, S? L Server, Oracle, Teradata, Netezza), BI tools, ETL, Change Data Capture, and application servers.
• Own critical components of data management, integration, and information systems, including software installation, configuration, administration, performance evaluation, and enhancement.
• Design, implement, and upgrade solutions for system installations, configurations, testing, and deployment.
• Define and document systems software/hardware requirements, system specifications, and necessary customisations.
• Coordinate the design and integration of complex systems and subsystems, ensuring seamless solution delivery across domains.
• Engineer the physical design of data, subsystems, and integration for robust, scalable solutions.
• Test and debug software (including S? L and infrastructure components) for reliability and performance.
• Develop and execute scripts to automate and enhance operational efficiency.
• Stay current with advances in hardware and software, including emerging data engineering best practices.
• Participate in production turnover activities to integrate new platforms and technologies into the environment.
• Diagnose, isolate, and resolve system and platform issues; lead troubleshooting and root cause analysis.
• Monitor the overall health of deployed technologies, implement patching, and identify system tuning opportunities.
• Ensure all systems adhere to standard designs and audit/compliance requirements.
• Create and update documentation, technical procedures, and user support guides.
• Oversee quality, security, and compliance, including updating and testing business continuity plans.
• Act as an escalation point for advanced system support and troubleshooting.
• Track platform consumption and manage environment changes.
• Lead technical initiatives and mentor less experienced team members.

Requirements:

• Minimum 5 years of experience in specific domains, systems and infrastructures, subsystems, and application integration.
• Specialised knowledge of information systems, data structures, programming methodologies, graphical user interfaces, and control languages.
• Advanced expertise in multiple query languages for data processing and analytics.
• Strong understanding of the organisation's information and application systems, including the interrelationships between different system components.
• Excellent organisational and troubleshooting skills, with keen attention to detail.
• Proven ability to understand client and stakeholder expectations, proactively identify and resolve issues that may impact project delivery.
• Strong interpersonal and communication skills, with the ability to work effectively in a matrix organisation.
• Experience collaborating with geographically distributed teams and working across different time zones.
• Self-motivated with a demonstrated ability to learn independently and a strong aptitude for delivering high-quality solutions beyond formal training.
• Possession of one or more globally recognised certifications and credentials in relevant technology domains is preferred.

Competencies:

• Demonstrates kindness, respect, and genuine interest in supporting colleagues and stakeholders.
• Maintains the highest standards of personal and professional ethics, acting with honesty and transparency.
• Embraces an inclusive mindset, encourages the expression of diverse ideas and opinions, and seeks input from others.
• Contributes positively to team morale, supports others, and fosters a collaborative work environment.
• Actively seeks feedback, pursues growth opportunities, and strives for excellence through continual skill development.

Skills Required:

• Relational/ Non-relational Databases: Azure S? L DB / MyS? L / PostgreSQL L/ MongoDB / Cassandra.
• ETL: Azure Data Factory/ Cloud Data Fusion/ Informatica/ Apache NiFi / AWS Glue.
• Cloud platform: GCP.
• Data warehousing: Big uery/ Data Lake/ Snowflake/ Redshift.
• Data Processing: Databricks/ Aurora/ Looker + Big data (Hadoop/Spark).

Additional Skills Required:

• Experience with Power BI or ThoughtSpot for data visualisation and analytics.
• Expertise in AI, preferably in the context of data engineering.
• Experience with Stone branch for job scheduling.
• Knowledge of CI/CD pipelines and DevOps practices.