QA / ETL Test Engineer

We are seeking an experienced QA / ETL Test Engineer with 5+ years of expertise in ETL Testing, Python, Kafka, Data Validation, and AI-enabled Quality Engineering. The ideal candidate will be responsible for validating data pipelines, testing Kafka-based data streams, developing automation solutions using Python, and leveraging AI-powered tools to improve testing efficiency, coverage, and defect detection.

Responsibilities:

• Perform ETL Testing, data reconciliation, and end-to-end data validation.
• Validate data movement across source systems, ETL processes, Kafka streams, and target databases.
• Develop and maintain test automation scripts using Python.
• Test and monitor Kafka producers, consumers, topics, and message flows.
• Perform SQL-based data verification and database testing.
• Integrate test automation into CI/CD pipelines and Agile delivery processes.
• Utilise AI-assisted testing tools and Generative AI for test case generation, test data creation, defect analysis, and test optimisation.
• Collaborate with developers, data engineers, and business stakeholders to ensure data quality and reliability.

Requirements:

• 5+ years of experience in ETL Testing and Data Validation.
• Strong hands-on experience with Python, SQL, and Kafka.
• Expertise in testing data warehouses, ETL pipelines, and large datasets.
• Experience with automation frameworks and scripting.
• Knowledge of REST API Testing and CI/CD tools (Jenkins, Git, Azure DevOps, etc. ).
• Familiarity with Agile and DevOps methodologies.
• Exposure to AI-powered testing tools, Microsoft Copilot, GitHub Copilot, or similar AI solutions.

Preferred Skills:

• Finance / Banking / Wealth Management domain experience preferred.
• Experience with data migration, data warehousing, and cloud data platforms.
• Knowledge of AI/ML concepts for test optimisation and predictive quality analytics.

Professional Attributes:

• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management abilities.
• Ability to work independently and within cross-functional teams.
• Proactive mindset with a focus on quality and continuous improvement.

Skills

ETL, Kafka, Python