{"id":128127,"url":"https://alion.io/job/sesame-ai-ml-model-serving-engineer","title":"ML Model Serving Engineer","company":{"id":48220,"name":"Sesame AI","domain":"sesame.com","url":"https://alion.io/company/sesame-ai","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":84,"open_postings":22,"ghost_share":0.182,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":148,"computed_at":"2026-10-17T05:46:00Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States","New York, United States","Bellevue, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":175000,"max":280000,"currency":"USD","period":"year","gross":null,"usd_annual":280000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":true,"technologies":[{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"PyTorch","optional":false},{"name":"SGLang","optional":false},{"name":"Voice Agents","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"GCP","optional":true},{"name":"Kubernetes","optional":true},{"name":"Ray","optional":true}],"status":"live","first_seen_at":"2025-03-14T23:09:29Z","employer_posted_date":"2025-03-14","last_verified_at":"2026-10-17T09:56:55Z","board_verified":true,"closed_at":null,"days_open":581,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":581},"description":"About Sesame\nSesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice agents part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive.\nResponsibilities:\nTurbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.\n\nPartner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category.\n\nModify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving.\n\nWork with the training team to identify opportunities to produce faster models without sacrificing quality.\n\nUse techniques like in-flight batching, caching, and custom kernels to speed up inference.\n\nFind ways to reduce model initialization times without sacrificing quality.\n\nRequired Qualifications:\nExpert in some differentiable array computing framework, preferably PyTorch.\n\nExpert in optimizing machine learning models for serving reliably at high throughput, with low latency.\n\nSignificant systems programming experience; ex. Experience working on high-performance server systems-you’d be just as comfortable with the internals of VLLM as you would with a complex PyTorch codebase.\n\nSignificant performance engineering experience; ex. Bottleneck analysis in high-scale server systems or profiling low-level systems code.\n\nAlways up to date on the latest techniques for model serving optimization.\n\nPreferred Qualifications:\nFamiliarity with high-performance LLM serving; ex. experience with VLLM, SGlang deployment, and internals.\n\nExperience with a public cloud platform such as GCP, AWS, or Azure.\n\nExperience deploying and scaling inference workloads in the cloud using Kubernetes, Ray, etc.\n\nYou like to ship and have a track record of leading complex multi-month projects without assistance.\n\nYou’re excited to learn new things and work in a multitude of roles.\n\nSesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilities. Contact  for assistance.\nFull-time Employee Benefits:\n401 (k) max employer match: 3.5% of compensation\n\n100% employer-paid health, vision, and dental benefits for you and your dependents\n\nUnlimited PTO and sick time\n\nFlexible spending account with employer matching up to $1,650/year (medical FSA)\n\nGuardian Employee Assistance Program (EAP)\n\nOpportunity to share in the company's success with competitive stock options\n\nBenefits do not apply to contingent/contract workers.","description_format":"text","description_chars":3070,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Stock options","Unlimited PTO"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Conversational AI","Speech & Audio AI"],"lifecycle":[{"event":"open","at":"2025-03-14T23:09:29Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 7","filings_12m":7,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":162500,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":3}],"liveness":{"score":7,"band":"cold","label":"Long shot","p_open":1,"p_active":0.252,"p_room":0.28,"age_days":581,"expected_fill_days":148,"reasons":["conf:3","ghost","win:tail","crowd:"],"computed_at":"2026-10-17T05:46:00Z"},"pay":{"stated_usd_annual":280000,"is_top_pay":true},"html_url":"https://alion.io/job/sesame-ai-ml-model-serving-engineer","json_url":"https://alion.io/job/sesame-ai-ml-model-serving-engineer.json","meta":{"generated_at":"2026-10-17T10:09:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13298,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":48220},"rest":"https://alion.io/mcp/rest/get_company?id=48220"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsesame-ai-ml-model-serving-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsesame-ai-ml-model-serving-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsesame-ai-ml-model-serving-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sesame-ai-ml-model-serving-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsesame-ai-ml-model-serving-engineer"}]}