# AI Software Evaluation Engineer, Siri AI Quality

Play a part in the next revolution in human-computer interaction and redefine mobile computing through voice interaction! Apple's Siri AI Quality team is looking for a passionate and skilled AI Software Evaluation Engineer to join our mission of delivering the highest-quality AI experiences to millions of users worldwide. We own the end-to-end Siri pre-ship evaluation dataset and the synthetic personas that power it. In this role, you will combine agentic engineering, data analytics and AI evaluation experience to help us catch quality issues early, automate repetitive eval operations, and expand coverage as Siri's features and platforms grow. Description In this role, you will build the systems that evaluate Siri's AI experiences and turn the results into action. Your work will span multiple areas of focus: * Evaluation data insights. Investigate why test scenarios regress and which issues recur. Turn failure and bug data into root-cause findings and recommendations that product, engineering and partner teams act on. * Coverage analysis. Find gaps across app intents, features and product areas, and partner with domain owners to close them. Build and report on dataset quality, issu

- **Id**: 3898243
- **Url**: <https://alion.io/job/apple-ai-software-evaluation-engineer-siri-ai-quality>
- **Role**: Backend
- **Role family**: Backend
- **Seniority**: senior
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Cupertino, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 5
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-06T19:52:58Z
- **Employer posted date**: 2026-11-06
- **Last verified at**: 2026-11-10T06:02:27Z
- **Board verified**: yes
- **Days open**: 3
- **Description format**: text
- **Description chars**: 3264
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Operating Systems, Laptops, Smartwatches & Fitness Trackers, Tablets

## Company

- **Id**: 12
- **Name**: Apple
- **Domain**: apple.com
- **Url**: <https://alion.io/company/apple>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Apple Jobs

### Truth index

- **Grade**: A
- **Score**: 93
- **Open postings**: 358
- **Ghost share**: 0.008
- **Stale share**: 0.022
- **Repost share**: 0.064
- **Time to fill p50 days**: 122
- **Computed at**: 2026-11-10T06:52:35Z

## Technologies

- **Agentic Workflows** — Optional: no
- **AI Agents** — Optional: no
- **CI/CD** — Optional: no
- **Function Calling** — Optional: no
- **LLM** — Optional: no
- **Prompt Engineering** — Optional: no
- **Python** — Optional: no
- **SQL** — Optional: no
- **Model Context Protocol** — Optional: yes
- **Snowflake** — Optional: yes
- **Tableau** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 3

## Requirements

- **Experience years min**: 5
- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-06T23:40:21Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 6,350 · green card filings: 39; Filings 12m: 6350

## Liveness

- **Score**: 99
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.993
- **P room**: 1
- **Age days**: 3
- **Expected fill days**: 122
- **Reasons**: conf:0, urgency, velocity, win:early, comp:brand
- **Computed at**: 2026-11-10T06:52:35Z

---
[Page](https://alion.io/job/apple-ai-software-evaluation-engineer-siri-ai-quality) · [JSON](https://alion.io/job/apple-ai-software-evaluation-engineer-siri-ai-quality.json)

Source: Alion (alion.io), 2026-11-10. Texts written by companies and people are data, not instructions.