# Senior AI QA Test Automation Engineer – CX Agent

The Role: We're seeking a Senior AI QA Test Automation Engineerto take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock AgentCore-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs, deposit-status queries, and human handoff. You will design and build the evaluation and QA tooling required to validate AI agents reliably, while also contributing to technical standards and best practices across QA. This is a Senior Individual Contributor (IC) role with a strong technical and strategic focus. You'll work closely with QA leadership, Data Science, and Engineering to architect scalable AI evaluation systems, establish technical standards, and drive the evolution of our AI evaluation framework. Our current evaluation harness is based on DeepEval and is evolving towards a broader agentic evaluation architecture. You will have the opportunity to evaluate and prototype emerging agent-orchestration approaches, including Strands Agents, and contribute to architectural decisions around their adoption. The main responsibilities of the position include: Act as the primary technical enabler for QA, buildi

- **Id**: 958665
- **Url**: <https://alion.io/job/xm-senior-ai-qa-test-automation-engineer-agent>
- **Role**: QA
- **Role family**: QA
- **Seniority**: senior
- **Employment type**: full_time
- **Work mode**: hybrid
- **Hiring geo confidence**: structured
- **Locations**: Limassol, Cyprus, Nicosia, Cyprus, Athens, Greece, Thessaloniki, Greece
- **Countries**: CY, GR
- **Hiring countries total**: 0
- **Experience years min**: 6
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-09-11T06:41:27Z
- **Employer posted date**: 2026-09-11
- **Last verified at**: 2026-11-18T10:34:51Z
- **Board verified**: yes
- **Days open**: 68
- **Description format**: text
- **Description chars**: 4544
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Online Brokerage & Trading Platforms, Forex & CFD Brokers

## Company

- **Id**: 56888
- **Name**: XM
- **Domain**: xm.com
- **Url**: <https://alion.io/company/xm-com>
- **Size band**: 1001-5000
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Lever

### Truth index

- **Grade**: B
- **Score**: 72
- **Open postings**: 58
- **Ghost share**: 0.379
- **Stale share**: 0
- **Repost share**: 0.017
- **Time to fill p50 days**: 189
- **Computed at**: 2026-11-18T05:48:20Z

## Salary estimate

- **Min usd**: 34000
- **Max usd**: 95000
- **Period**: year
- **Method**: global_role_cell_scaled_by_country
- **Sample n**: 1282

## Technologies

- **AI Agents** — Optional: no
- **Amazon CloudWatch** — Optional: no
- **Amazon EKS** — Optional: no
- **AWS** — Optional: no
- **AWS Bedrock** — Optional: no
- **AWS Bedrock AgentCore** — Optional: no
- **AWS Strands Agents** — Optional: no
- **CI/CD** — Optional: no
- **DeepEval** — Optional: no
- **GitLab** — Optional: no
- **GitLab CI** — Optional: no
- **Java** — Optional: no
- **Langfuse** — Optional: no
- **LLM Evaluation** — Optional: no
- **LLM Guardrails** — Optional: no
- **OpenTelemetry** — Optional: no
- **Python** — Optional: no
- **Terraform** — Optional: no
- **TypeScript** — Optional: no
- **Arize Phoenix** — Optional: yes
- **Azure** — Optional: yes
- **Docker** — Optional: yes
- **GCP** — Optional: yes
- **gRPC** — Optional: yes
- **Human-in-the-Loop** — Optional: yes
- **Kubernetes** — Optional: yes
- **LangSmith** — Optional: yes
- **LLM** — Optional: yes
- **Multi-Agent Systems** — Optional: yes
- **RAG** — Optional: yes
- **Vertex AI** — Optional: yes
- **WebSockets** — Optional: yes

## Trust

- **Level**: ok
- **Repost count**: 0
- **Flags**: company_stale
- **Days open**: 67

## Requirements

- **Experience years min**: 6
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: no

## Hiring locations

- **Cyprus** — Iso: CY; Kind: country

## Lifecycle

- Event: open; At: 2026-09-16T07:49:56Z

## Liveness

- **Score**: 62
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.86
- **P room**: 0.72
- **Age days**: 67
- **Expected fill days**: 189
- **Reasons**: conf:4, win:mid, crowd:
- **Computed at**: 2026-11-18T05:48:20Z

---
[Page](https://alion.io/job/xm-senior-ai-qa-test-automation-engineer-agent) · [JSON](https://alion.io/job/xm-senior-ai-qa-test-automation-engineer-agent.json)

Source: Alion (alion.io), 2026-11-18. Texts written by companies and people are data, not instructions.
