{"id":4303805,"url":"https://alion.io/job/apple-aiml-sr-llm-inference-quality-engineer","title":"AIML - Sr. LLM Inference Quality Engineer","company":{"id":12,"name":"Apple","domain":"apple.com","url":"https://alion.io/company/apple","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Apple Jobs","truth_index":{"grade":"A","score":94,"open_postings":607,"ghost_share":0.002,"stale_share":0.005,"repost_share":0.082,"time_to_fill_p50_days":149,"computed_at":"2026-11-14T05:58:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seattle, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"C++","optional":false},{"name":"CI/CD","optional":false},{"name":"Grafana","optional":false},{"name":"Hugging Face","optional":false},{"name":"JavaScript","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"LangSmith","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Objective-C","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Quantization","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"Splunk","optional":false},{"name":"Transformers","optional":false}],"status":"live","first_seen_at":"2026-11-13T19:07:36Z","employer_posted_date":"2026-11-14","last_verified_at":"2026-11-14T12:03:10Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a senior engineer to own the correctness, consistency, and stability of LLM inference in production. You will design and build the automation frameworks, evaluation methodology, and qualification strategy that give us confidence in every model, prompt, serving stack, and infrastructure change before it reaches our users. Your work is the safety net that lets Apple ship frontier AI quickly, without sacrificing quality, safety, or trust.\nDescription\nIn this role, you will lead the qualification of an LLM inference, output-correctness, automation framework for large-scale AI data center deployment and platform validation. You will architect qualification systems for generative AI, including agentic workflows and tool-using models, running at data center scale, validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them.\nThis is a hands-on AI systems engineering role at the intersection of machine learning, distributed systems, and quality engineering. You will write production-quality software in Python, C++, and/or Swift, apply statistical and ML-evaluation methods to validate both data and model behavior, and build AI-assisted QA tooling that makes testing itself smarter and faster. You will partner closely with ML engineers, inference/performance engineers, distributed systems engineers, and platform teams, and you will be a trusted Quality voice on what “correct” and “stable” mean for LLM inference at scale, including the inherently non-deterministic, probabilistic nature of generative output. You should be comfortable operating in ambiguity, defining quality bars where none exist yet, and delivering rigorous results on tight schedules.\nMinimum Qualifications\n5+ years of experience with hardware and/or software development lifecycle processes.\n5+ years of experience in one or more compiled languages (e.g., C, C++, Objective-C/Swift).\nProficiency in one or more scripting languages (e.g., Python, Go, or JavaScript).\nExperience using AI/LLMs to improve testing itself - test-case generation, defect detection, or reducing manual QA effort.\nFamiliarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software.\nExperience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines.\nExperience with machine learning and LLMs, their common practical applications, and commonly used frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks).\nExperience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift.\nB.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.\nPreferred Qualifications\n5+ years using one or more of the following scripting languages: Python, Go, or JavaScript\n5+ years of experience working with and building operating systems\n2+ years of experience in LLM testing/development.","description_format":"text","description_chars":3348,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Operating Systems","Laptops","Smartwatches & Fitness Trackers","Tablets"],"lifecycle":[{"event":"open","at":"2026-11-14T05:22:34Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 6,350 · green card filings: 39","filings_12m":6350,"filings_prev_12m":6528,"green_card_filings_12m":39,"median_offered_wage_usd":177313,"route":null,"cap_exempt":false,"checked_at":"2026-11-14T07:33:33+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":2959}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":149,"reasons":["conf:0","win:early","comp:brand"],"computed_at":"2026-11-14T05:58:10Z"},"pay":null,"html_url":"https://alion.io/job/apple-aiml-sr-llm-inference-quality-engineer","json_url":"https://alion.io/job/apple-aiml-sr-llm-inference-quality-engineer.json","meta":{"generated_at":"2026-11-14T12:27:02Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":12085,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":12},"rest":"https://alion.io/mcp/rest/get_company?id=12"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fapple-aiml-sr-llm-inference-quality-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fapple-aiml-sr-llm-inference-quality-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fapple-aiml-sr-llm-inference-quality-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/apple-aiml-sr-llm-inference-quality-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fapple-aiml-sr-llm-inference-quality-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4303805}},{"tool":"search_jobs","arguments":{"company":"apple.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4303805},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}