Senior Data Engineer

The candidate will have responsibilities across the following functions:

Infrastructure Maintenance and Optimisation:

• Design and review data pipeline diagrams for both client and internal projects.
• Build data pipelines by writing clean, efficient SQL queries for data analysis and quality checks.
• Monitor data pipeline performance and infrastructure costs, proactively resolving issues and identifying opportunities to improve reliability, efficiency, and cost-effectiveness.
• Maintain and upgrade Goalkeep's internal tech infrastructure.

Tech Leadership and Team Enablement:

• Provide technical guidance, troubleshooting support, and coaching to strengthen data analysts' skills so that they can successfully deliver on client projects.
• Create technical documentation, troubleshooting guides and reusable resources that improve team efficiency.
• Foster a culture of curiosity, continuous learning and knowledge sharing across the team.

AI-Enabled Data Engineering and Innovation:

• Explore and leverage AI tools to improve the efficiency, reliability and scalability of Goalkeep's data engineering workflows.
• Identify opportunities to automate repetitive engineering and data quality tasks using AI-assisted approaches.
• Work with internal teams to embed AI into engineering workflows while ensuring reliability, transparency and maintainability.

The core requirements for the job include the following:

Hard Skills:

• Data modelling and database management (PostgreSQL, MySQL, or SQL Server).
• Data engineering: writing efficient SQL, designing pipelines.
• Installing and maintaining software on Linux systems.
• Familiarity with cloud-based platforms (AWS / GCP / Azure) is a must.

Soft Skills and Mindsets:

• Ability to coach others through patient communication & technical guidance.
• Curiosity and accountability when investigating system issues.
• Strong problem-solving ability with a structured and analytical approach.

Preferred Qualifications:

• Engineering degree with a minimum of 4 years of experience working as a data scientist/data analyst/ data engineer.
• Bachelor's degree in any STEM field.
• Experience in SQL (any dialect).
• Knowledge of software engineering best practices and version control (Git).

Skills

AWS, Azure, ETL, GCP, MySQL, PostgreSQL, SQL, SQL Server, data engineering