Lead Senior Associate | Data Engineering

Core Responsibilities:

• Design, build, and maintain ETL/ELT pipelines.
• Develop scalable data architectures on Azure and Snowflake.
• Integrate data from APIs, databases, streaming platforms, and third-party systems.
• Ensure data quality, governance, and performance optimization.
• Support analytics, BI, AI/ML, and reporting teams.
• Implement monitoring, logging, and workflow automation.
• Create and maintain data models and technical documentation.

Mandatory Skills Snowflake:

• Snowflake Data Warehouse
• Snowpipe
• Streams & Tasks
• Time Travel
• Snowpark

Azure Data Engineering Stack:

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure SQL Database
• Azure Data Lake

Programming:

• Python
• SQL / T-SQL
• PySpark
• Spark SQL
• Basic knowledge of KQL

Data & ETL:

• Data Modeling (ERD, Dimensional Modeling)
• ETL/ELT Development
• Experience with ADF
• Exposure to dbt, Fivetran, Matillion, or Airflow

Additional Technical Skills:

• Hadoop & Spark (working knowledge)
• Performance Tuning & Troubleshooting
• Git
• Azure DevOps

Preferred Skills:

• Chat applications and Micro Frontends
• Microsoft Teams Bot Framework
• Adaptive Cards
• D3.js / Highcharts
• Azure Web Apps
• Python-based web development

Education:

• BE / B.Tech / ME / M.Tech / BCA / MCA / MBA

Ideal Candidate Profile:

A Data Engineer with 4-6 years of experience who has strong hands-on expertise in Snowflake, Azure Data Factory, Databricks, PySpark, SQL, Data Modeling, and end-to-end ETL development, along with exposure to modern cloud data platforms and Azure ecosystem services.

Skills

ADF, Azure, Databricks, PySpark, Python, SQL, Snowflake, Synapse