# Senior QA Engineer, AI

Job Description ICE's AI Center of Excellence is looking for a Senior Software Test Engineer to own QA for our AI powered applications. This role works with Systems Analysts, Development, and QA to understand business/product and system requirements and define test scenarios for AI applications, combining core QA fundamentals, Python scripting, and API validation with specialized AI/LLM evaluation skills such as detecting hallucinations, bias, and drift. Responsibilities Lead test strategy for AI/ML features: model output validation, regression testing across model/prompt versions, and edge case discovery. Build evaluation frameworks for testing AI outputs for accuracy, consistency, bias, hallucination, and safety/guardrail compliance. Define golden datasets, ground truth labels, and release acceptance criteria with data science and ML engineering. Automate prompt based test suites and model evaluation metrics into CI/CD release gates. Lead and mentor a QA team, setting AI testing standards across projects. Translate AI feature requirements into test scenarios and quality gates. Monitor production of AI behavior and evolve test coverage based on real world failures. Knowledge and E

- **Id**: 4239668
- **Url**: <https://alion.io/job/intercontinental-exchange-senior-qa-engineer-ai-2>
- **Role**: QA
- **Role family**: QA
- **Seniority**: senior
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Hyderabad, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 8
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-13T11:57:30Z
- **Employer posted date**: 2026-11-13
- **Last verified at**: 2026-11-13T12:19:23Z
- **Board verified**: yes
- **Days open**: 0
- **Description format**: text
- **Description chars**: 2998
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Financial Software & Embedded Finance, Stock Exchanges & Market Infrastructure, Financial Data & Market Intelligence

## Company

- **Id**: 58612
- **Name**: Intercontinental Exchange
- **Domain**: ice.com
- **Url**: <https://alion.io/company/intercontinental-exchange>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: iCIMS

### Truth index

- **Grade**: A
- **Score**: 96
- **Open postings**: 6
- **Ghost share**: 0
- **Stale share**: 0.167
- **Repost share**: 0
- **Time to fill p50 days**: 36
- **Computed at**: 2026-11-12T10:38:37Z

## Technologies

- **Amazon SageMaker** — Optional: no
- **AWS** — Optional: no
- **Azure** — Optional: no
- **CI/CD** — Optional: no
- **Cypress** — Optional: no
- **DeepEval** — Optional: no
- **GCP** — Optional: no
- **GDPR** — Optional: no
- **Git** — Optional: no
- **GraphQL** — Optional: no
- **Hallucination** — Optional: no
- **ISO 27001** — Optional: no
- **LangSmith** — Optional: no
- **LLM** — Optional: no
- **LLM Evaluation** — Optional: no
- **LLM Guardrails** — Optional: no
- **NIST AI RMF** — Optional: no
- **Playwright** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no
- **Ragas** — Optional: no
- **Rest API** — Optional: no
- **Selenium** — Optional: no
- **SOC 2** — Optional: no
- **SQL** — Optional: no
- **Vertex AI** — Optional: no

## Trust

- **Level**: ok
- **Days open**: 0

## Requirements

- **Experience years min**: 8
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-13T11:57:30Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 36
- **Reasons**: conf:1, win:early
- **Computed at**: 2026-11-13T13:32:49Z

---
[Page](https://alion.io/job/intercontinental-exchange-senior-qa-engineer-ai-2) · [JSON](https://alion.io/job/intercontinental-exchange-senior-qa-engineer-ai-2.json)

Source: Alion (alion.io), 2026-11-13. Texts written by companies and people are data, not instructions.