# AI Test Engineer - Python/Automation

Job Description - AI Testing Engineer Experience: 3 - 5 Years Location: Chennai / Bangalore Job Summary: We are looking for an AI Testing Engineer with experience in software testing, Python automation, and validation of AI-powered applications. Key Responsibilities: - Perform functional, API, integration, and regression testing of AI applications. - Validate AI/ML and Generative AI outputs for accuracy and reliability. - Test LLM responses, prompts, and hallucinations. - Develop automated test scripts using Python and PyTest. - Identify defects and collaborate with development teams to resolve issues. Required Skills: - 3 - 5 years of experience in software testing. - Strong Python and test automation skills. - Experience in API testing using Postman. - Knowledge of AI/ML, Generative AI, and LLM testing. - Hands-on experience in evaluation testing (Eval Testing) of AI/LLM applications, including response quality, accuracy, relevance, and consistency. - Understanding of SQL, Git, and defect-tracking tools such as Jira. Preferred: - Hands-on experience with RAG applications and AI evaluation frameworks such as DeepEval or Ragas. Skills Automation Testing, Softwar

- **Id**: 4364268
- **Url**: <https://alion.io/job/neoware-technology-solutions-ai-test-engineer-pythonautomation>
- **Role**: QA
- **Role family**: QA
- **Seniority**: middle
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Bengaluru, India, Chennai, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-16T08:16:26Z
- **Last verified at**: 2026-11-16T08:16:26Z
- **Board verified**: no
- **Days open**: 0
- **Description format**: text
- **Description chars**: 1295
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Analytics & BI Consulting, Data Engineering & Migration Services

## Company

- **Id**: 3801120
- **Name**: Neoware Technology Solutions
- **Domain**: neoware.ai
- **Url**: <https://alion.io/company/neoware-technology-solutions>
- **Is staffing agency**: no
- **Employer type**: services
- **Is intermediary**: no

## Technologies

- **DeepEval** — Optional: no
- **Git** — Optional: no
- **Jira** — Optional: no
- **LLM** — Optional: no
- **Machine Learning** — Optional: no
- **Postman** — Optional: no
- **Pytest** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no
- **Ragas** — Optional: no
- **SQL** — Optional: no

## Trust

- **Level**: not_scored
- **Days open**: 0

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-16T10:40:27Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 26
- **Reasons**: seen:0, win:early
- **Computed at**: 2026-11-16T12:05:26Z

---
[Page](https://alion.io/job/neoware-technology-solutions-ai-test-engineer-pythonautomation) · [JSON](https://alion.io/job/neoware-technology-solutions-ai-test-engineer-pythonautomation.json)

Source: Alion (alion.io), 2026-11-16. Texts written by companies and people are data, not instructions.
