# AI QA Engineer

Work Description : - Own the acceptance test plan: define how 95% detection accuracy and - 5% area variance are measured, and enforce the split between the calibration set used for tuning and the held-out set used for acceptance - Build and maintain the coverage matrix across design types and symbol classes, flagging thin or empty cells as known gaps - Report accuracy per symbol class with confidence intervals, not just an aggregate figure, and enforce the per-class minimum instance count below which a class is reported as provisional - Run no-regression checks across fine-tune rounds so a new model cannot pass on average while regressing on a rare but critical class - Build the Knowledge Bot evaluation suite: a curated Q&A set with known-correct answers, scored for groundedness and faithfulness against every prompt and model version - Perform adversarial and AI security testing before production and after material architectural change prompt injection, jailbreak attempts, RAG-specific attacks, cross-user data isolation and AI data leakage - Validate correction-quality controls: spot-audit ambiguous classes, track inter-reviewer agreement, and confirm conflicting human corre

- **Id**: 4068327
- **Url**: <https://alion.io/job/v2soft-ai-qa-engineer>
- **Role**: QA
- **Role family**: QA
- **Seniority**: senior
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Bengaluru, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 6
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-11T11:08:47Z
- **Last verified at**: 2026-11-11T11:08:47Z
- **Board verified**: no
- **Days open**: 0
- **Description format**: text
- **Description chars**: 2651
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: IT Consulting & Digital Transformation, Custom Software Development

## Company

- **Id**: 694467
- **Name**: V2Soft
- **Domain**: v2soft.com
- **Url**: <https://alion.io/company/v2soft>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: SmartRecruiters

## Salary

- **Min**: 2000000
- **Max**: 2700000
- **Currency**: INR
- **Period**: year
- **Gross**: yes
- **Usd annual**: 28795

## Technologies

- **LLM Evaluation** — Optional: no
- **Pytest** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no
- **Amazon SageMaker** — Optional: yes
- **LLM** — Optional: yes
- **MLFlow** — Optional: yes

## Trust

- **Level**: not_scored
- **Days open**: 0

## Requirements

- **Experience years min**: 6
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-11T12:29:45Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 29
- **Reasons**: seen:0, win:early
- **Computed at**: 2026-11-11T13:11:48Z

## Pay

- **Stated usd annual**: 28795
- **Is top pay**: no

---
[Page](https://alion.io/job/v2soft-ai-qa-engineer) · [JSON](https://alion.io/job/v2soft-ai-qa-engineer.json)

Source: Alion (alion.io), 2026-11-11. Texts written by companies and people are data, not instructions.