Data Engineer

You will act as a key member of the data consulting team, working directly with the partners and senior stakeholders of the clients, designing and implementing big data and analytics solutions. Communication and organizational skills are key for this position, along with a problem-solving attitude.

Responsibilities:

• Develop data solutions within a Big Data Azure and/or other cloud environments.
• Work with divergent data sets that meet the requirements of the Data Science and Data Analytics teams.
• Build and design data architectures using Azure Data Factory, Databricks, Data Lake, and Synapse.
• Liaising with CTO, product owners, and other operations teams to deliver engineering roadmaps showing key items such as upgrades, technical refreshes, and new versions.
• Perform data mapping activities to describe source data, target data, and the high-level or detailed transformations that need to occur.
• Assist the Data Analyst team in developing KPIs and reporting in tools viz. Power BI and Tableau.
• Data Integration, Transformation, Modelling.
• Maintain all relevant documentation and knowledge bases.
• Research and suggest new database products, services, and protocols.

Requirements:

• You should be able to work independently and communicate effectively with remote teams.
• Timely communication/escalation of issues/dependencies to higher management.
• Curiosity to learn and apply emerging technologies to solve business problems.

Essential Technical Skills:

• Technical expertise with emerging Big Data technologies, such as Python, Spark, Hadoop, Clojure, Git, SQL, and Databricks; and visualization tools: Tableau and Power BI.
• Experience with cloud, container, and microservice infrastructures.
• Experience working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams.
• Hands-on experience with data modeling, query techniques, and complexity analysis.

Desirable Skills:

• Experience/Knowledge of working in an agile environment and experience with agile methodologies such as Scrum.
• Experience working with development teams and product owners to understand their requirements.
• Certifications in any of the above areas will be preferred.

Skills

azure, cloud, data, databricks, hadoop, python, spark, sql