{"id":750727,"url":"https://alion.io/job/sciforium-lead-software-engineer-model-serving-platform","title":"Lead Software Engineer, Model Serving Platform","company":{"id":716759,"name":"Sciforium","domain":"sciforium.ai","url":"https://alion.io/company/sciforium-2","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":84,"open_postings":6,"ghost_share":0,"stale_share":0.833,"repost_share":0,"time_to_fill_p50_days":11,"computed_at":"2026-11-05T05:54:30Z"}},"role":"Backend","role_family":"Backend","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San Francisco, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":230000,"max":300000,"currency":"USD","period":"year","gross":null,"usd_annual":300000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"Kubernetes","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Multimodal AI","optional":false},{"name":"Python","optional":false},{"name":"Ray","optional":false},{"name":"HPC","optional":true},{"name":"ROCm","optional":true},{"name":"SGLang","optional":true},{"name":"vLLM","optional":true}],"status":"live","first_seen_at":"2026-08-17T16:36:21Z","employer_posted_date":"2026-08-17","last_verified_at":"2026-11-05T07:05:25Z","board_verified":true,"closed_at":null,"days_open":79,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":79},"description":"Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.\nAbout the role\nThis is a rare chance to help architect and lead the development of Sciforium’s next-generation model serving platform, the high-performance engine that will bring a multimodal, highly efficient foundation model to market. As a senior technical leader, you’ll not only build core components yourself but also guide and mentor other engineers, influencing engineering direction, standards, and execution quality.\nYou will learn and shape the full AI stack: from GPU kernels and quantized execution paths to distributed serving, scheduling, and the APIs that power real-time AI applications. If you enjoy deep systems work, thrive on ownership, and want to lead engineers in building foundational AI infrastructure, this role puts you at the center of SciForium’s mission and growth.\nWhat you'll do\nLead the technical direction of the model serving platform, owning architecture decisions and guiding engineering execution.\n\nBuild core serving components including execution runtimes, batching, scheduling, and distributed inference systems.\n\nDevelop high-performance C++ and CUDA/HIP modules, including custom GPU kernels and memory-optimized runtimes.\n\nCollaborate with ML researchers to productionize new multimodal models and ensure low-latency, scalable inference.\n\nBuild Python APIs and services that expose model capabilities to downstream applications.\n\nMentor and support other engineers through code reviews, design discussions, and hands-on technical guidance.\n\nDrive performance profiling, benchmarking, and observability across the inference stack.\n\nEnsure high reliability and maintainability through testing, monitoring, and engineering best practices.\n\nTroubleshoot and resolve complex issues across GPU, runtime, and service layers.\n\nIdeal candidate profile\nBachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience\n\n5+ years of experience designing and building scalable, reliable backend systems or distributed infrastructure.\n\nStrong understanding of LLM inference mechanics (prefill vs decode, batching, KV cache)\n\nExperience with Kubernetes/Ray, Containerization\n\nStrong proficiency in C++, Python.\n\nStrong debugging, profiling, and performance optimization skills at the system level.\n\nAbility to collaborate closely with ML researchers and translate model or runtime requirements into production-grade systems.\n\nEffective communication skills and the ability to lead technical discussions, mentor engineers, and drive engineering quality.\n\nComfortable working from the office and contributing to a fast-moving, high-ownership team culture.\n\nNice-to-have\nExperience with ML systems engineering, distributed GPU scheduling, open source inference engine like vLLM, Sglang, or TRT-LLM\n\nExperience in building large scale ML/MLOps infrastructure\n\nProficiency in CUDA or ROCm and experience with GPU profiling tools\n\nExperience at an AI/ML startup, research lab, or Big Tech infrastructure/ML team.\n\nFamiliarity with multimodal model architectures, raw-byte models, or efficient inference techniques.\n\nContributions to open-source ML or HPC infrastructure\n\nBenefits include\nMedical, dental, and vision insurance\n\n401k plan\n\nDaily lunch, snacks, and beverages\n\nFlexible time off\n\nCompetitive salary and equity\n\nEqual opportunity\nSciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.","description_format":"text","description_chars":3909,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["401k plan","Equity","Flexible time off","Vision insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Compute & Inference"],"lifecycle":[{"event":"open","at":"2026-09-11T15:41:32Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"H-1B filings in 12 months: 5","filings_12m":5,"filings_prev_12m":0,"green_card_filings_12m":0,"median_offered_wage_usd":175500,"route":null,"cap_exempt":false,"checked_at":"2026-10-29T16:27:21+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":5}],"liveness":{"score":10,"band":"cold","label":"Long shot","p_open":1,"p_active":0.352,"p_room":0.28,"age_days":79,"expected_fill_days":11,"reasons":["conf:4","win:tail","crowd:"],"computed_at":"2026-11-05T05:54:30Z"},"pay":{"stated_usd_annual":300000,"is_top_pay":true},"html_url":"https://alion.io/job/sciforium-lead-software-engineer-model-serving-platform","json_url":"https://alion.io/job/sciforium-lead-software-engineer-model-serving-platform.json","meta":{"generated_at":"2026-11-05T11:15:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14415,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-06T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":716759},"rest":"https://alion.io/mcp/rest/get_company?id=716759"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsciforium-lead-software-engineer-model-serving-platform"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsciforium-lead-software-engineer-model-serving-platform"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsciforium-lead-software-engineer-model-serving-platform"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sciforium-lead-software-engineer-model-serving-platform\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsciforium-lead-software-engineer-model-serving-platform"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":750727}},{"tool":"search_jobs","arguments":{"company":"sciforium.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":750727},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}