{"id":2134308,"url":"https://alion.io/job/apple-machine-learning-engineer-ai-ml-evaluation-frameworks","title":"Machine Learning Engineer - AI & ML Evaluation Frameworks","company":{"id":12,"name":"Apple","domain":"apple.com","url":"https://alion.io/company/apple","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Apple Jobs","truth_index":{"grade":"A","score":94,"open_postings":180,"ghost_share":0,"stale_share":0.011,"repost_share":0.044,"time_to_fill_p50_days":153,"computed_at":"2026-11-18T05:48:20Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Cupertino, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":214000,"max_usd":414000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":508},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Git","optional":false},{"name":"Interpretability","optional":false},{"name":"Machine Learning","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Python","optional":false},{"name":"Sensor Fusion","optional":false},{"name":"Synthetic Data","optional":false},{"name":"AI Agents","optional":true},{"name":"Federated Learning","optional":true},{"name":"Kubernetes","optional":true},{"name":"LLM","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"RAG","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-06-08T20:51:14Z","employer_posted_date":"2026-11-18","last_verified_at":"2026-11-19T01:00:11Z","board_verified":true,"closed_at":null,"days_open":163,"trust":{"level":"ok","repost_count":2,"flags":[],"days_open":160},"description":"The Health Sensing Machine Learning Interpretability & Analytics (MLIA) team ensures clinical rigor and contextual trust are at the foundation of Apple’s health sensing features. We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations into model performance. You will develop cutting-edge tools, synthetic data pipelines, and automated frameworks that ensure our health features are mathematically sound, demographically equitable, and clinically safe. If you are passionate about AI safety, robust software architecture, and pushing the boundaries of ML innovation, come join us!\nDescription\nIn this role, you will architect and build large-scale evaluation frameworks to interrogate unimodal ML systems and multi-modal foundation models. Beyond infrastructure, you will lead deep-dive ML evaluations, performing failure analysis to uncover performance gaps, reasoning flaws, and edge cases. You will translate findings into actionable insights and work directly with algorithm teams to improve the safety and reliability of our health features. Your work will empower teams across Apple to rapidly evaluate multi-modal sensor fusion while upholding Apple's privacy standards.\nMinimum Qualifications\nBS in Computer Science, Machine Learning, Statistics, or related field\n3+ years of experience in ML Engineering or Applied ML\nStrong experience in evaluating supervised, unsupervised, LLMs and deep learning models.\nProficiency in Python with the ability to write production-grade code (OOP, CI/CD, Git)\nHands-on experience in failure analysis, evaluating LLMs and driving subsequent model improvements\nExperience building data pipelines, inference frameworks, and automated evaluation systems\nStrong communication skills to articulate complex technical concepts across technical and non-technical audiences\nPreferred Qualifications\nMS/PhD in Computer Science, Machine Learning, Statistics, or related field\nExperience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation)\nExperience with synthetic data generation and prompt engineering\nExperience in parallel data processing (Spark, Kubernetes, Airflow) or privacy-preserving ML (Federated Learning)\nBackground in AI Safety, model interpretability, or adversarial testing\nInterest in digital health and clinical rigor","description_format":"text","description_chars":2387,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Operating Systems","Smartwatches & Fitness Trackers","Tablets"],"lifecycle":[{"event":"open","at":"2026-10-09T01:28:51Z"},{"event":"close","at":"2026-10-09T01:39:59Z"},{"event":"reopen","at":"2026-10-09T06:17:28Z"},{"event":"close","at":"2026-10-11T12:23:15Z"},{"event":"reopen","at":"2026-10-11T15:08:15Z"},{"event":"close","at":"2026-10-11T23:11:48Z"},{"event":"reopen","at":"2026-10-12T02:31:52Z"},{"event":"close","at":"2026-10-12T11:04:10Z"},{"event":"reopen","at":"2026-10-12T17:08:32Z"},{"event":"close","at":"2026-10-19T23:56:35Z"},{"event":"reopen","at":"2026-10-20T03:37:22Z"},{"event":"close","at":"2026-10-20T15:30:45Z"},{"event":"reopen","at":"2026-10-21T03:21:23Z"},{"event":"close","at":"2026-10-21T16:58:38Z"},{"event":"reopen","at":"2026-10-22T04:58:48Z"},{"event":"close","at":"2026-10-23T12:04:11Z"},{"event":"reopen","at":"2026-10-23T21:35:07Z"},{"event":"close","at":"2026-11-04T20:23:34Z"},{"event":"reopen","at":"2026-11-05T06:26:16Z"},{"event":"close","at":"2026-11-06T18:41:53Z"},{"event":"reopen","at":"2026-11-06T23:47:23Z"},{"event":"close","at":"2026-11-10T00:24:00Z"},{"event":"reopen","at":"2026-11-10T11:20:05Z"},{"event":"close","at":"2026-11-11T22:29:36Z"},{"event":"reopen","at":"2026-11-12T09:50:20Z"},{"event":"close","at":"2026-11-12T16:09:35Z"},{"event":"reopen","at":"2026-11-14T05:22:34Z"},{"event":"close","at":"2026-11-17T00:11:55Z"},{"event":"reopen","at":"2026-11-18T16:50:39Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 6,518 · green card filings: 214","filings_12m":6518,"filings_prev_12m":7008,"green_card_filings_12m":214,"median_offered_wage_usd":176830,"route":null,"cap_exempt":false,"checked_at":"2026-11-18T07:32:00+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":2981}],"liveness":{"score":27,"band":"fade","label":"Fading","p_open":1,"p_active":0.609,"p_room":0.44,"age_days":163,"expected_fill_days":153,"reasons":["conf:1","repost:2","win:tail","crowd:brand"],"computed_at":"2026-11-19T02:22:58Z"},"pay":null,"html_url":"https://alion.io/job/apple-machine-learning-engineer-ai-ml-evaluation-frameworks","json_url":"https://alion.io/job/apple-machine-learning-engineer-ai-ml-evaluation-frameworks.json","meta":{"generated_at":"2026-11-19T02:22:58Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4220,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12},"rest":"https://alion.io/mcp/rest/get_company?id=12"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fapple-machine-learning-engineer-ai-ml-evaluation-frameworks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fapple-machine-learning-engineer-ai-ml-evaluation-frameworks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fapple-machine-learning-engineer-ai-ml-evaluation-frameworks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/apple-machine-learning-engineer-ai-ml-evaluation-frameworks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fapple-machine-learning-engineer-ai-ml-evaluation-frameworks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":2134308}},{"tool":"search_jobs","arguments":{"company":"apple.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":2134308},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}