Data Engineer

Requirements

• Experience in design and development of automated data pipelines and data structures
• Senior experience in Python Programming
• Hands-on data engineering for data warehouse solutions using Snowflake, SQL, dbt and Airflow
• Experience on building Event stream processing systems on Kafka or similar technology and experience in building event based services
• Knowledge of building CI/CD pipelines using GitLab
• Working with Agile Delivery teams (Scrum, Kanban) and JIRA
• Ability to build automated testing to test data pipelines
• Support transition from on-premises solutions to cloud first strategy (AWS & Snowflake)
• Up-to-date knowledge of technology standards, industry trends, emerging technologies and software development best practices
• Demonstrable experience of ITIL processes within a 2nd/3rd line support environment

Responsibilities

• Being key operational and hands-on engineer delivering Business tenancies for SwapClear and Listed Rates as part of the data platform strategy execution across all areas of the business
• Acting as a member of the program and work with product teams across SwapClear and Listed Rates to design and implement modern, scalable data solutions using a range of new and emerging technologies contributing to innovation in the data space
• Working on developing and supporting the AWS & Snowflake based cloud data platform as well as helping to support and migrate data from legacy platforms

This is an opportunity to play a key part in the roll-out of a new cloud-based analytics platform and the role would suit an ambitious individual keen to develop their skills and knowledge.

Apply here or send us your resume at: [email protected] , let’s have a talk.