Data Engineer with Power BI Expertise

Job Description:

The Associate 1 – Data Engineering Developer is an individual contributor responsible for designing, building, and optimizing scalable data pipelines, data models, and integration solutions. The role requires strong hands-on expertise in modern data engineering tools and cloud platforms (Azure/AWS/GCP), along with the ability to work independently, collaborate with cross-functional teams, and drive high-quality data delivery.

Data Engineering:

• Build, execute, and maintain scalable data pipelines using Azure Data Factory (ADF) and Databricks.
• Integrate data from multiple sources and ensure data consistency, quality, and accuracy, leveraging ADLS.
• Support data warehousing activities using Azure Synapse Analytics and relevant Azure services.
• Implement ETL processes to ensure smooth data movement across systems.
• Contribute to data modeling/schema efforts to support analytical use cases.
• Use Databricks notebooks for transformations, creating tables, and ensuring data quality/consistency, including Unity Catalog for governance where applicable.
• Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance.
• Foster a collaborative and inclusive team environment, promoting knowledge sharing and best practices.
• Maintain accurate project status for self and team, ensuring timely delivery of milestones.
• Optimize data storage and retrieval processes to enhance system performance and reduce latency.
• Apply business transformations using Databricks notebooks.
• Build and manage data transformations, create tables, and ensure data quality and consistency using Databricks notebooks.
• Leverage Unity Catalog for data governance and maintaining a unified data view across the organization.

Skills

ADF, Azure Data Factory, Databricks, ETL