Sr Lead Engineer - I_ETL Testing

• ETL testing, Data Warehousing, and Database validation
• Power BI testing and validation
• Writing and optimizing SQL queries across multiple databases
• UI, and API (REST) testing
• Mandatory Skills

Demonstrated experience in ETL and data pipeline validation, ensuring data accuracy, completeness, and integrity across systems.

Proven ability to validate file ingestion processes, including performing comprehensive checks on Parquet, CSV, and TXT files within Azure Data Lake Storage (ADLS) using Python.

Strong hands-on experience in executing and validating SQL queries via Python across platforms such as Snowflake, Azure SQL Managed Instance, and Amazon Redshift.

Experience in executing, monitoring, and validating Azure Data Factory (ADF) pipelines, ensuring successful orchestration and data movement across environments.

Desired Skills

Strong proficiency in SQL, Python, Azure cloud services, Snowflake, and Azure Data Factory (ADF)

Hands-on experience in data testing automation using Python, leveraging libraries such as: (pandas, pyodbc, requests, sqlalchemy, Azure SDKs, and database cursors)

Exposure to modern test automation frameworks, including Robot Framework and Pytest, for scalable and maintainable test execution

Job Description

Mandatory Skills:

The ideal candidate must have strong hands-on experience in:

• Data Analyst & ETL testing, Data Warehousing, and Database validation
• Power BI testing and validation
• Writing and optimizing SQL queries across multiple databases
• Handling and validating data across various file formats
• Azure integration and Azure DevOps pipelines

Role & Responsibilities:

• Possess 10+ years of experience in Data Analysis ,QA across ETL, Data Warehouse, BI, Data Quality, and UI testing
• Perform end-to-end validation of data pipelines / ETL processes
• Develop and execute test strategies for data validation, UI, and API (REST) testing
• Demonstrate hands-on expertise in Python, including libraries for:
• Database interaction
• File handling
• API testing
• Azure integration
• Design and implement test plans and test data preparation strategies
• Create and maintain test cases, test scenarios, and test documentation aligned with standard templates
• Manage defect lifecycle, including:
• Defect identification and logging
• Usage of defect templates
• Timely reporting and tracking
• Participate in Agile estimation activities, including:
• T-shirt sizing
• Planning Poker for features, user stories, and releases
• Track, analyze, and report QA quality metrics to stakeholders as required
• Provide technical guidance and support to team members to resolve queries and challenges
• Collaborate closely with developers, QA teams, and cross-functional stakeholders to identify, troubleshoot, and resolve defects efficiently
• Exhibit strong communication, interpersonal, and team collaboration skills

Nice to Have (Preferred Skills)

• Experience in designing or working with data testing automation frameworks
• Experience with automation of data testing across:
• On-premise and Azure cloud environments
• Regression test suite automation
• Hands-on experience with:
• Python-based automation (pandas, pytest, requests, sqlalchemy, cursors, Azure SDKs)
• Azure DevOps Test Plans and pipelines

• Snowflake Database