{"id":3375922,"url":"https://alion.io/job/apple-machine-learning-engineer-evaluation-and-quality-creativity-apps","title":"Machine Learning Engineer, Evaluation and Quality, Creativity Apps","company":{"id":12,"name":"Apple","domain":"apple.com","url":"https://alion.io/company/apple","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Apple Jobs","truth_index":{"grade":"A","score":90,"open_postings":850,"ghost_share":0,"stale_share":0.179,"repost_share":0.002,"time_to_fill_p50_days":93,"computed_at":"2026-11-03T05:54:40Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Diego, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":225000,"max_usd":433000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":1332},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Swift","optional":false}],"status":"live","first_seen_at":"2026-10-27T22:29:39Z","employer_posted_date":"2026-10-28","last_verified_at":"2026-11-03T19:22:13Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.\nThe Creativity Apps team is looking for a Machine Learning Engineer focused on the quality and evaluation of ML models and AI features in our creativity applications. You will define how we measure whether the product and AI features are good enough to ship: designing the evaluation strategy and metrics, building the datasets and infrastructure behind them, and driving end-to-end quality from model development through to the feature in customers' hands. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of creators every day.\nDescription\nIn this role, you will own the evaluation and quality of AI features across Creativity Apps. You will work closely with Machine Learning engineering, infrastructure, product, and design teams to understand each model and use case, and translate them into evaluation methodology, testing strategy, and quality metrics that reflect what creators actually experience.\nYou will:\n* Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.\n* Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.\n* Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.\n* Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.\n* Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.\n* Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.\n* Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.\nYour curiosity about the latest developments in ML and generative AI, and your drive to apply new technology to practical problems, will set you apart.\nMinimum Qualifications\n5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.\nExperience with evaluation methodology for ML models, LLMs, and AI products or features.\nStrong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.\nSolid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.\nTrack record of applying LLMs, or agentic workflows to ML evaluation and quality.\nExperience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.\nExperience designing, implementing, maintaining, or optimizing ML evaluation infrastructure at scale.\nExperience designing evaluation metrics based on the model, the product, and its use cases.\nExperience driving end-to-end evaluation and quality for AI products.\nFluency in quality reporting, presenting quality data to both technical and non-technical audiences.\nStrong communication skills and experience working with and driving cross-functional partners.\nProficient in Python and/or Swift or comparable languages.\nBachelor's degree in Computer Science, Data Science, Machine Learning, or a related field, or equivalent experience.\nPreferred Qualifications\nKnowledge of the software development life cycle and software quality assurance methodologies.\nExperience in objective image and video quality evaluation and metrics.\nKnowledge of color science and/or experience with subjective image or video quality review.\nPassion for creative applications; experience as a creator (photo, video, music, or design) is a plus.\nExcitement about learning new technology and applying it to practical problems.\nFamiliarity with iOS and macOS.","description_format":"text","description_chars":4361,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Operating Systems","Laptops","Smartwatches & Fitness Trackers","Tablets"],"lifecycle":[{"event":"open","at":"2026-10-28T02:40:25Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 6,350 · green card filings: 37","filings_12m":6350,"filings_prev_12m":6527,"green_card_filings_12m":37,"median_offered_wage_usd":177355,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":2959}],"liveness":{"score":99,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.993,"p_room":1,"age_days":6,"expected_fill_days":93,"reasons":["conf:1","urgency","velocity","win:early","comp:brand"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/apple-machine-learning-engineer-evaluation-and-quality-creativity-apps","json_url":"https://alion.io/job/apple-machine-learning-engineer-evaluation-and-quality-creativity-apps.json","meta":{"generated_at":"2026-11-03T21:30:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":770,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12},"rest":"https://alion.io/mcp/rest/get_company?id=12"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fapple-machine-learning-engineer-evaluation-and-quality-creativity-apps"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fapple-machine-learning-engineer-evaluation-and-quality-creativity-apps"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fapple-machine-learning-engineer-evaluation-and-quality-creativity-apps"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/apple-machine-learning-engineer-evaluation-and-quality-creativity-apps\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fapple-machine-learning-engineer-evaluation-and-quality-creativity-apps"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3375922}},{"tool":"search_jobs","arguments":{"company":"apple.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3375922},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}