Data Engineer

Data Engineer

About the role:

We are searching high and low for our next Data Engineer to join our world-class team.

What will you be doing?

• You will be helping to build data-centric solutions for a Client's customers, applying engineering discipline to ensure high quality. Responsible for building data pipelines to bring together information from different source systems-to integrate, consolidate, cleanse and structure data.
• This isn’t a backroom role, and you can expect to spend time discussing design approaches and requirements with your colleagues and customers in addition to being engaged in development activities.

Experience:

• 5-10 years of experience
• Experience with varied types of data: tabular, graph, time-series, geospatial, image, etc.
• Practical knowledge of Different types of databases - relational; document; graph; columnar; key-value
• Different types of database - relational; document; graph; columnar; key-value
• Large-scale data processing platforms, typically based on Hadoop / Spark
• Business intelligence/analytics products or frameworks
• Data visualisation frameworks
• Knowledge of Data processing capabilities in Azure; AWS and GCP (2 out of three)
• Knowledge of data integration technologies
• Knowledge of distributed computing and information security
• Ability to write good quality code in a JVM language like Java or Scala, incorporating disciplines such as Test Driven Development and structured version control; familiarity with Python is a bonus