# AI QA Evaluation Engineer

AI QA / Evaluation Engineer (Enterprise AI Agents) The QA / Evaluation Engineer will work directly with business stakeholders and engineering teams to define, execute and continuously improve testing and evaluation practices for enterprise AI agents and agentic workflows. Reporting to the AI Platform Manager, this role is responsible for ensuring all AI solutions are functional, reliable, compliant and fit for purpose prior to release. The role owns evaluation frameworks and test standards, and is accountable for maintaining development and test environments to support consistent, high-quality delivery. The role will also liaise directly with business users to support user acceptance testing and to validate end-user built agents ahead of publishing, ensuring alignment with enterprise standards, governance requirements and quality thresholds. Responsibilities Define and implement testing and evaluation frameworks for AI agents and agentic workflows, covering functional quality, groundedness, safety, reliability, and performance. Develop and execute test plans, test cases, evaluation criteria, test data, datasets, and benchmark scenarios to ensure consistent and repeatable validation

- **Id**: 4063660
- **Url**: <https://alion.io/job/aptiv-ai-qa-evaluation-engineer>
- **Role**: QA
- **Role family**: QA
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Dublin, Ireland
- **Countries**: IE
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-09T00:00:00Z
- **Employer posted date**: 2026-11-09
- **Last verified at**: 2026-11-11T19:18:15Z
- **Board verified**: yes
- **Days open**: 3
- **Description format**: text
- **Description chars**: 6298
- **Description truncated**: no
- **Benefits**: Gym membership
- **Relocation offered**: no
- **Industries**: Passive Components & Connectors, Automotive Components, Automotive Software, Electrical Equipment & Cables

## Company

- **Id**: 5724
- **Name**: Aptiv
- **Domain**: aptiv.com
- **Url**: <https://alion.io/company/aptiv>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Workday

### Truth index

- **Grade**: B
- **Score**: 79
- **Open postings**: 202
- **Ghost share**: 0
- **Stale share**: 0.832
- **Repost share**: 0
- **Time to fill p50 days**: 44
- **Computed at**: 2026-11-11T05:49:22Z

## Technologies

- **Agentic Workflows** — Optional: no
- **Agile** — Optional: no
- **AI Agents** — Optional: no
- **Kanban** — Optional: no
- **Azure** — Optional: yes
- **CI/CD** — Optional: yes
- **Copilot Studio** — Optional: yes
- **Hallucination** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 3

## Requirements

- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: no

## Hiring locations

- **Ireland** — Iso: IE; Kind: country

## Lifecycle

- Event: open; At: 2026-11-11T10:09:53Z

## Visa

- Country: IE; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: Irish employment permits in 12 months: 11; Filings 12m: 11

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 3
- **Expected fill days**: 45
- **Reasons**: conf:14, win:early, comp:brand
- **Computed at**: 2026-11-12T09:44:00Z

---
[Page](https://alion.io/job/aptiv-ai-qa-evaluation-engineer) · [JSON](https://alion.io/job/aptiv-ai-qa-evaluation-engineer.json)

Source: Alion (alion.io), 2026-11-12. Texts written by companies and people are data, not instructions.