# Senior Software Development Engineer in Test — LLM Evaluation & Automation, T3E

The Apple Intelligence Platform Experience Validation team builds the tooling and automation that keeps Apple Intelligence features high-quality before they ship. We are looking for a Senior SDET to lead the design and implementation of automated model evaluation: standing up LLM-as-a-judge in existing and new pipelines, and building the infrastructure that catches model regressions before they reach human evaluation or the live on population. This is a hands-on, senior individual-contributor role. You will own eval automation as a discipline across the team, partnering with modeling, framework, and infrastructure teams to make model quality a first-class, continuously measured signal. Description You will build and maintain model level, component or end-to-end evaluation coverage for the generative features our team validates. Your job is to leverage LLM judge scoring output quality in automation, ensuring reliable, repeatable eval jobs that run that produce actionable signal. The kinds of problems you will work on include: * Image / visual generation: validating model output and its associated classification metadata, and detecting quality or behavior regressions across model upd

- **Id**: 2133044
- **Url**: <https://alion.io/job/apple-senior-software-development-engineer-in-test-llm-evaluation-automation-t3e>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: senior
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: San Diego, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-08-03T21:34:43Z
- **Employer posted date**: 2026-11-18
- **Last verified at**: 2026-11-19T08:25:13Z
- **Board verified**: yes
- **Days open**: 107
- **Description format**: text
- **Description chars**: 3632
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Operating Systems, Laptops, Smartwatches & Fitness Trackers, Tablets

## Company

- **Id**: 12
- **Name**: Apple
- **Domain**: apple.com
- **Url**: <https://alion.io/company/apple>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Apple Jobs

### Truth index

- **Grade**: B
- **Score**: 73
- **Open postings**: 1666
- **Ghost share**: 0.212
- **Stale share**: 0.002
- **Repost share**: 0.615
- **Time to fill p50 days**: 153
- **Computed at**: 2026-11-19T09:08:57Z

## Salary estimate

- **Min usd**: 229000
- **Max usd**: 441000
- **Period**: year
- **Method**: role_seniority_country_remote_cell
- **Sample n**: 1332

## Technologies

- **LLM** — Optional: no
- **CI/CD** — Optional: yes
- **NLP** — Optional: yes
- **Python** — Optional: yes
- **Rest API** — Optional: yes
- **SQL** — Optional: yes

## Trust

- **Level**: ok
- **Repost count**: 1
- **Days open**: 107

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: yes

## Lifecycle

- Event: open; At: 2026-10-09T01:16:33Z
- Event: close; At: 2026-10-20T19:26:25Z
- Event: reopen; At: 2026-10-21T03:16:03Z
- Event: close; At: 2026-10-21T16:58:38Z
- Event: reopen; At: 2026-10-21T21:38:17Z
- Event: close; At: 2026-10-21T21:49:40Z
- Event: reopen; At: 2026-10-22T01:51:31Z
- Event: close; At: 2026-11-04T20:23:34Z
- Event: reopen; At: 2026-11-05T06:21:11Z
- Event: close; At: 2026-11-06T18:41:53Z
- Event: reopen; At: 2026-11-06T23:40:21Z
- Event: close; At: 2026-11-10T00:24:00Z
- Event: reopen; At: 2026-11-10T05:56:30Z
- Event: close; At: 2026-11-11T22:29:36Z
- Event: reopen; At: 2026-11-12T04:23:18Z
- Event: close; At: 2026-11-12T16:09:35Z
- Event: reopen; At: 2026-11-13T04:11:20Z
- Event: close; At: 2026-11-13T10:47:28Z
- Event: reopen; At: 2026-11-13T23:46:56Z
- Event: close; At: 2026-11-17T04:54:28Z
- Event: reopen; At: 2026-11-18T12:15:40Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 6,545 · green card filings: 214; Filings 12m: 6545

## Liveness

- **Score**: 51
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.847
- **P room**: 0.6
- **Age days**: 107
- **Expected fill days**: 153
- **Reasons**: conf:0, win:late, crowd:brand
- **Computed at**: 2026-11-19T09:08:57Z

---
[Page](https://alion.io/job/apple-senior-software-development-engineer-in-test-llm-evaluation-automation-t3e) · [JSON](https://alion.io/job/apple-senior-software-development-engineer-in-test-llm-evaluation-automation-t3e.json)

Source: Alion (alion.io), 2026-11-19. Texts written by companies and people are data, not instructions.
