{"id":3367063,"url":"https://alion.io/job/netflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving","title":"Staff/ Principal Software Engineer (L6/L7): AI Platform Model Serving","company":{"id":5888,"name":"Netflix","domain":"netflix.com","url":"https://alion.io/company/netflix","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Eightfold","truth_index":{"grade":"A","score":86,"open_postings":79,"ghost_share":0,"stale_share":0.367,"repost_share":0,"time_to_fill_p50_days":71,"computed_at":"2026-11-05T05:54:30Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":235000,"max_usd":451000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":285},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"A/B Testing","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"GCP","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Prompt Caching","optional":false},{"name":"SGLang","optional":false},{"name":"Speculative Decoding","optional":false},{"name":"Triton Inference Server","optional":false},{"name":"vLLM","optional":false},{"name":"AI Agents","optional":true},{"name":"CUDA","optional":true},{"name":"DeepSpeed","optional":true},{"name":"Hugging Face","optional":true},{"name":"JAX","optional":true},{"name":"KV Cache","optional":true},{"name":"Machine Learning","optional":true},{"name":"NCCL","optional":true},{"name":"PyTorch","optional":true},{"name":"Quantization","optional":true},{"name":"TensorFlow","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"TGI","optional":true},{"name":"Transformers","optional":true}],"status":"live","first_seen_at":"2026-10-27T23:31:15Z","employer_posted_date":"2026-10-27","last_verified_at":"2026-11-05T16:34:46Z","board_verified":true,"closed_at":null,"days_open":8,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":8},"description":"At Netflix, our mission is to entertain the world. Together, we are writing the next episode - pushing the boundaries of storytelling, global fandom and making the unimaginable a reality. We are a dream team obsessed with the uncomfortable excitement of discovering what happens when you merge creativity, intuition and cutting-edge technology. Come be a part of what’s next.\nNetflix is on the journey to rebuild the AI/ML model serving platform and infrastructure that turns trained models into served predictions across real-time, async, and agentic workloads, at a scale few companies operate at. Supporting many production clusters, from classical to foundation models, spanning latencies from milliseconds rankers to LLM calls, and powering everything members see from homepage ranking to search, messaging, and internal AI productivity tools.\nWe are re-building a new model serving platform from the ground up, designed from first principles to meet industry standards. It unifies our in-house inference infrastructure, third-party model hosting, and external LLM providers under a single serving, routing, and experimentation layer. Teams get one consistent way to deploy, route, and A/B test any model, regardless of where it runs.\nRe-engineering how GPU capacity is provisioned and used. During off-peak periods, the same fleet that serves latency-critical production traffic is repurposed to run open-weight models for internal coding and developer productivity use cases.\nThis role sits at the center of Netflix’s GenAI and Foundation Model serving strategy, with real R&D scope on frontier AI infrastructure. You will tackle the efficiency problems that most directly drive cost per inference and capacity: disaggregated serving, intelligent routing across models and providers, speculative decoding, prompt caching, and multi-GPU inference. These are the levers that turn GPU spend into measurable business value.\nYou will lead the technology behind some of Netflix’s largest bets, embedding AI capabilities into member-facing products at global scale. You will also build durable, resumable execution for long-running agentic workloads. Online and asynchronous/ Near-Real-Time inference is projected to grow fast in 2028, so getting this foundation right now is what keeps costs sustainable and reliability high as demand scales.\nThis is a rare very senior level opportunity to set and own the technical direction for a platform at the intersection of massive production scale, aggressive cost/ utilization engineering, and genuinely unsolved problems in GenAI serving by leading the technical architecture and directions for a growing engineering organization.\nLooking for deep expertise in distributed systems and high-performance RPC, GPU/CPU inference optimization, control planes, and experimentation infrastructure, plus fluency with modern LLM serving stacks and a track record of architecting systems that hold together under both extreme scale and rapid technology change.\nQualifications and Expectations\nTo succeed in this role, you will need:\nHave a BS/MS/PhD in Computer Science, Applied Math, Engineering, or a related field. With relevant experience in the AI/ ML Infrastructure and distributed systems for 12+ years.\nInfluence without authority to guide architectural decisions and alignment across multi-teams through trust, data, and demonstrated expertise.\nShape long-term technical roadmaps (typically looking 2 to 3 years ahead) and ensure scalability, maintainability, and business alignment.\nCross-Functional Partnership: Work closely with product managers, operations, and executive stakeholders to balance technical trade-offs with business priorities.\nClear Communication skill to translate dense technical concepts for non-technical stakeholders and produce clear documentation, architecture decision records (ADRs), and proposals.\nHave experience with high-traffic distributed services and infrastructure for AI/ ML model inference, with a focus on high availability, security, and performance.\nHave experience building scalable model-serving solutions for Foundation Models that powers generative and predictive AI applications with practical skills in reducing latency and costs.\nFamiliar with deploying AI/ ML models using platform and solutions such as NVIDIA Triton Inference Server, vLLM, or SGLang, and scaling them via Kubernetes.\nHave experience working with public cloud infrastructure providers such as AWS, Azure, or GCP.\nPreferred Qualifications:\nHave open-source contributions to projects in the AI/ML, distributed systems, or infrastructure space.\nHands-on experience with building AI models, and have explored optimization techniques for AI models, such as quantization, model compression, or model pruning.\nProficient in leveraging AI coding tools in software development.\nHave experience working with model gateway and intelligent routing for choosing the right AI models based on context of the requests.\nExposure to deploying multi-adapters model serving, disaggregated prefill/decode, or large-scale KV cache management. \nWorking with evaluation and benchmarking tools for LLMs and AI Agents.\nKnowledge of GPU topology, NVIDIA CUDA programming, and machine learning compilers.\nKey technologies & ecosystem\nDeep Learning frameworks: Pytorch, TensorFlow, JAX, Hugging Face Transformers\nInference Engines and Runtimes: vLLM, SGLang, TensorRT-LLM, TGI (Text Generation Inference), DeepSpeed-Inference, NVIDIA Dynamo\nHardware and Low-Level: CUDA, NCCL, and profiling tools like NVIDIA Nsight.\nTo learn more about our AI Platform, you can review the relevant talks/blog posts on the Netflix AI Platform Research website.Place holder...coming soon\nGenerally, our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $890,000.00 - $1,690,000.00. This compensation range will vary based on location.Netflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more details about our Benefits here.\nNetflix is a unique culture and environment. Learn more here.\nInclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner.\nWe are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.\nJob is open for no less than 7 days and will be removed when the position is filled.","description_format":"text","description_chars":7631,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Flexible time off","Retirement plans","Stock options"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Streaming & OTT Platforms"],"lifecycle":[{"event":"open","at":"2026-10-27T23:31:15Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 439 · green card filings: 64","filings_12m":439,"filings_prev_12m":290,"green_card_filings_12m":64,"median_offered_wage_usd":252321,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":283}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":8,"expected_fill_days":71,"reasons":["conf:0","velocity","win:early","comp:brand"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/netflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving","json_url":"https://alion.io/job/netflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving.json","meta":{"generated_at":"2026-11-05T21:22:42Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1143,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5888},"rest":"https://alion.io/mcp/rest/get_company?id=5888"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fnetflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fnetflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fnetflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/netflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fnetflix-staff-principal-software-engineer-l6l7-ai-platform-model-serving"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3367063}},{"tool":"search_jobs","arguments":{"company":"netflix.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3367063},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}