{"id":2131850,"url":"https://alion.io/job/apple-staff-experience-designer-ai-evaluation-platform-2","title":"Staff Experience Designer, AI Evaluation Platform","company":{"id":12,"name":"Apple","domain":"apple.com","url":"https://alion.io/company/apple","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Apple Jobs","truth_index":{"grade":"B","score":81,"open_postings":969,"ghost_share":0,"stale_share":0.765,"repost_share":0,"time_to_fill_p50_days":49,"computed_at":"2026-10-19T05:45:15Z"}},"role":"Design","role_family":"Design","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seattle, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":270000,"max_usd":469000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":176},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Claude Code","optional":false},{"name":"Braintrust","optional":true},{"name":"LangSmith","optional":true},{"name":"SQL","optional":true}],"status":"live","first_seen_at":"2026-09-14T21:49:08Z","employer_posted_date":"2026-10-09","last_verified_at":"2026-10-19T12:13:13Z","board_verified":true,"closed_at":null,"days_open":34,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":34},"description":"AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function, it is a foundational science.\nOur team, part of Apple Services Engineering, builds the platform that teams across Apple use to evaluate the AI and agentic systems they ship. It's where they define what \"good\" means, prove it, and act on what they find. Evaluating non-deterministic systems is one of the hardest unsolved problems in production ML, and one Apple has to get right at scale.\nWe're looking for a Staff Experience Designer to own that experience end to end. You'll be the first designer on this platform, and evaluation as a design practice doesn't have settled patterns yet, so your work will help define them.\nDescription\nTeams building AI features need to know if what they shipped works. Today that means navigating unfamiliar territory: scoring something non-deterministic, telling a real regression from noise, trusting a judgment a model made instead of a person. Most existing tools here were built for the researchers who invented these methods, not for the people who now need to use them daily.\nYou'll set the direction here and build the design system everyone else builds on. We'd rather get a rough version in front of real users than a polished one later. And because teams use this platform to decide what to ship, trust matters more than usual: provenance, uncertainty, and edge cases determine whether someone acts on a result or quietly stops believing it.\nWhat makes this team unusual is its interdisciplinary core. Alongside the platform, we run a research group working on evaluation methodology itself, including how to tell whether an evaluator is calibrated, biased, or measuring what it claims to. Their methods ship into this platform, and you decide how anyone first encounters them. You'll be close to that work while it's still forming, instead of picking it up once it's finished.\nMinimum Qualifications\n8+ years of experience designing digital products or experiences, including end-to-end ownership of complex, data-dense products for technical users. You've set direction in spaces with no existing precedent, and you get to clarity by running research yourself with the people who use what you build.\nA portfolio you can share, including at least one case study that walks through your process from problem framing to shipped outcome.\nProven ability to design complex information: dashboards, comparison views, large result sets, and results that carry statistical uncertainty.\nStrong interaction and visual design skills, with a high bar for craft in dense, information-heavy interfaces.\nEnough fluency in AI/ML concepts (benchmarks, metrics, model-based judging, agentic systems) to work directly with a research scientist or engineer.\nFluency with AI tools in your own practice. You use Claude Code or equivalents to build working prototypes and extend what you can make on your own.\nExcellent communication skills, with the ability to build buy-in across engineering and research without formal authority.\nPreferred Qualifications\nExperience as the first or only designer on a platform, and/or experience translating research output into shipped product.\nExperience building and maintaining a design system, including its components, patterns, and naming conventions.\nAn AI-first instinct for interface design: shipped interfaces organized around stated intent, or surfaces meant to be operated by agents as well as people.\nExperience designing coherent workflows across multiple surfaces (UI, CLI, SDK) that need to stay consistent with each other.\nFamiliarity with modern evaluation, observability, or visualization tooling (e.g. LangSmith, Braintrust, D3, Vega-Lite).\nComfort with SQL and notebooks to explore your own data.","description_format":"text","description_chars":3865,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Operating Systems","Laptops","Smartwatches & Fitness Trackers","Tablets"],"lifecycle":[{"event":"open","at":"2026-10-09T01:09:42Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6,350 · green card filings: 37","filings_12m":6350,"filings_prev_12m":6527,"green_card_filings_12m":37,"median_offered_wage_usd":177355,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":47,"band":"ok","label":"Likely open","p_open":1,"p_active":0.621,"p_room":0.75,"age_days":34,"expected_fill_days":49,"reasons":["conf:1","stale_co","urgency","velocity","win:late","comp:brand"],"computed_at":"2026-10-19T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/apple-staff-experience-designer-ai-evaluation-platform-2","json_url":"https://alion.io/job/apple-staff-experience-designer-ai-evaluation-platform-2.json","meta":{"generated_at":"2026-10-19T15:45:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11748,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12},"rest":"https://alion.io/mcp/rest/get_company?id=12"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fapple-staff-experience-designer-ai-evaluation-platform-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fapple-staff-experience-designer-ai-evaluation-platform-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fapple-staff-experience-designer-ai-evaluation-platform-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/apple-staff-experience-designer-ai-evaluation-platform-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fapple-staff-experience-designer-ai-evaluation-platform-2"}]}