# AI Applied Scientist, AI Evaluation Science

AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function, it is a foundational science. Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction. Our goal is evidence that teams can act on: what to measure, whether a change helped, why a system failed, and whether it is ready to ship. What makes this team unusual is its interdisciplinary core. You will work alongside measurement scientists (psychometrics, validity theory), ML researchers, and platform engineers, bringing together ML research, statistical rigor, and production engineering. We are looking for an Applied Scientist who works across the full arc of evaluation science: turning research into tools engineers can use on their own, and turning what those engineers run into new research. You care whether a method holds up on real data, at real scale, for a real decision, and you are curious enough to go after the open question underneath when it doesn't. Description Our team is

- **Id**: 4418176
- **Url**: <https://alion.io/job/apple-ai-applied-scientist-ai-evaluation-science>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: middle
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Seattle, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-16T20:57:20Z
- **Employer posted date**: 2026-11-17
- **Last verified at**: 2026-11-18T12:21:41Z
- **Board verified**: yes
- **Days open**: 1
- **Description format**: text
- **Description chars**: 5776
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Operating Systems, Laptops, Smartwatches & Fitness Trackers, Tablets

## Company

- **Id**: 12
- **Name**: Apple
- **Domain**: apple.com
- **Url**: <https://alion.io/company/apple>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Apple Jobs

### Truth index

- **Grade**: A
- **Score**: 94
- **Open postings**: 180
- **Ghost share**: 0
- **Stale share**: 0.011
- **Repost share**: 0.044
- **Time to fill p50 days**: 153
- **Computed at**: 2026-11-18T05:48:20Z

## Technologies

- **AI Agents** — Optional: no
- **Fine-tuning** — Optional: no
- **LLM** — Optional: no
- **Machine Learning** — Optional: no
- **Python** — Optional: no
- **A/B Testing** — Optional: yes
- **DeepEval** — Optional: yes
- **Docker** — Optional: yes
- **Function Calling** — Optional: yes
- **Kubernetes** — Optional: yes
- **LangSmith** — Optional: yes
- **Multi-Agent Systems** — Optional: yes
- **Ragas** — Optional: yes
- **Ray** — Optional: yes
- **Spark** — Optional: yes
- **TruLens** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 1

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: master
- **Optional**: no

## Lifecycle

- Event: open; At: 2026-11-17T00:11:55Z

## Visa

- Country: US; Licensed sponsor: yes; Adverts offering sponsorship 24m: 0; Sanctioned now: no; Evidence: H-1B filings in 12 months: 6,518 · green card filings: 214; Filings 12m: 6518

## Liveness

- **Score**: 99
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.993
- **P room**: 1
- **Age days**: 1
- **Expected fill days**: 153
- **Reasons**: conf:3, urgency, velocity, win:early, comp:brand
- **Computed at**: 2026-11-18T05:48:20Z

---
[Page](https://alion.io/job/apple-ai-applied-scientist-ai-evaluation-science) · [JSON](https://alion.io/job/apple-ai-applied-scientist-ai-evaluation-science.json)

Source: Alion (alion.io), 2026-11-18. Texts written by companies and people are data, not instructions.
