Data Engineer

Relevant Experience:

• Has a minimum of 4 years of experience in data engineering and business intelligence - designing, developing, testing, and implementing data solutions.
• 1+ years using/exposure to any of Power BI/Tableau/Analysis Services data solutions, or comparable tools in the cloud data warehousing, transformation, and visualization space.
• 2+ years of experience with more than 1 database system, such as Snowflake/Redshift, Azure Synapse, BigQuery, Oracle, SQL Server, MySQL.
• Create and manage data source connections and integrate tables into tabular models.

Required skills:

Technical:

• ETL/ELT and SQL coding using cloud-based database solutions such as Azure SQL, Synapse, Redshift, Snowflake or similar tools.
• Design and develop star schema data models, and ETL/ELT jobs, to support use cases across typical business domains.
• Design/develop using best-practices techniques across data modelling, use of table-driven control of transformation jobs, and dynamic ETL/ELT jobs that scale for expanding use cases.
• Establish and maintain reporting dashboard solutions for enterprise-wide and executive analytics, including maintenance of back-end transformation layers and data pipelines.
• Exposure to programming languages, i.e., Python, Java, etc.

Non-Technical:

• Has worked closely with customer and business stakeholders, solution/technical architects, business analysts and project managers to design, develop and execute business use-cases.
• Interface with adjacent teams, including business users, report readers, report developers, and other data engineers to establish a consistent and polished approach to coping, design, development and rollout of BI and analytics solutions.
• Has taken part in high level design (HLD) and low-level design (LLD) phases in close collaboration with business heads, data engineers, and data and enterprise architects.
• Experience handling client requirements and communication directly.
• Exceptional communication, analytical, conceptual, and problem-solving abilities.

Preferred skills:

Technical:

• EAI or designing/developing a distributed systems architecture experience is a plus.
• Knowledge and implementation of role and row-based security across all layers of the data architecture and build a user-friendly consumption layer to enable self-service analytics.
• Advanced understanding of SQL development in both stored procedures and leveraging ETL/ELT tools, such as ADF, Matillion, Informatica, SSIS.
• Knowledge of API-led connectivity, microservices, events-based integration is a plus.

Non-Technical:

• Ability to work with abstract problem statements in ambiguous customer environments and work independently and provide technical leadership to the IT team.
• Ability to work on solutioning, technical architecture, high-level design and low-level design for cloud and on-prem databases, applications, and systems integration.

Skills

BigQuery, ELT, ETL, Oracle, Redshift, SQL, Snowflake, Synapse