Quality Assurance Engineer
First seen by Alion on Sep 29, 2026.
QA Engineer / Senior QA Engineer - GenAI Testing
Experience: 4 - 8 Years
Location: PAN India
Work Model: Hybrid - 3 Days Work From Office
Employment Type: Full-Time
Notice Period: Immediate to 30 Days Preferred
Job Summary:
We are looking for a skilled QA Engineer / Senior QA Engineer with strong experience in Python, UI Automation, UiPath, API Testing, and Database Testing, along with exposure to GenAI application testing. The candidate will be responsible for testing both traditional software applications and AI-powered solutions, including LLM-based applications, RAG systems, AI chatbots, Agentic AI workflows, and enterprise automation solutions.
Key Responsibilities:
- Develop and execute test strategies and test cases for software and GenAI applications.
- Design and execute test cases for LLM and RAG-based systems.
- Build and maintain Python-based test automation frameworks.
- Perform UI, API, database, integration, and end-to-end testing.
- Perform UiPath workflow and automation testing.
- Validate AI-generated responses for accuracy, consistency, relevance, and quality.
- Perform prompt testing, output validation, grounding validation, and hallucination detection.
- Test AI chatbots, virtual assistants, document processing, and document Q&A solutions.
- Validate Agentic AI and multi-agent workflows, including agent decisions and human-in-the-loop processes.
- Automate regression test suites and support continuous testing.
- Perform performance and reliability testing for AI applications.
- Identify, document, and track defects using Jira.
- Support root-cause analysis and troubleshooting.
- Collaborate with Architects, Developers, Product Owners, and Business teams.
Mandatory Skills:
Python:
- Python-based test automation
- API automation using Python
- Data validation scripts
- JSON processing
UI Automation & UiPath:
- UiPath Studio
- UiPath Test Suite
- UiPath Orchestrator
- Workflow validation
- End-to-end automation testing
API Testing:
- Postman
- REST APIs
- Swagger
- JSON/XML validation
Database Testing:
- SQL
- Data reconciliation
- Backend/data validation
Defect Management & Agile:
- Jira
- Agile/Scrum methodologies
- Sprint testing
- Test planning and estimation
GenAI Testing - Good to Have:
Hands-on experience in one or more of the following:
- GenAI application testing/validation
- LLM-based application testing
- RAG solution testing
- Prompt testing
- Prompt engineering validation
- AI output verification
- Hallucination detection
- Grounding validation
- Toxicity and bias testing
- Response quality evaluation
- Agentic AI testing
- Multi-agent workflow testing
- Agent decision validation
- Human-in-the-loop testing
- AI chatbot / virtual assistant testing
- Document processing solutions
Skills
Python, UiPath, Automation Testing, API Testing, Database Testing, Software Quality Assurance, Testing, Test Strategy, AI/ML Testing