{"id":1020010,"url":"https://alion.io/job/furiosa-software-engineer-ai-model-enablement-inference","title":"Software Engineer, AI Model Enablement & Inference","company":{"id":31683,"name":"FuriosaAI","domain":"furiosa.ai","url":"https://alion.io/company/furiosa","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"A","score":100,"open_postings":38,"ghost_share":0,"stale_share":0,"repost_share":0.026,"time_to_fill_p50_days":33,"computed_at":"2026-11-15T07:52:55Z"}},"role":"Backend","role_family":"Backend","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Seoul, South Korea"],"countries":["KR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Mixture of Experts","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Rust","optional":false},{"name":"SGLang","optional":false},{"name":"vLLM","optional":false},{"name":"CUDA","optional":true},{"name":"TensorRT","optional":true},{"name":"TensorRT-LLM","optional":true},{"name":"TPU","optional":true},{"name":"Triton","optional":true}],"status":"live","first_seen_at":"2026-09-18T02:05:55Z","employer_posted_date":"2026-10-21","last_verified_at":"2026-11-15T04:52:11Z","board_verified":true,"closed_at":null,"days_open":58,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":58},"description":"About FuriosaAI\nFuriosaAI builds high-performance, high-efficiency AI compute for the Inference Era. Founded in 2017 by veteran semiconductor and AI algorithm engineers, Furiosa operates globally with offices in Korea and Silicon Valley, along with a compiler-focused R&D lab in Lisbon. \nOur vision is to make AI computing sustainable, enabling access to powerful AI for everyone on Earth. We solve the AI hardware energy and operational cost crisis at the architectural level, rather than through brute force, building the world's first truly AI-native compute platform to unlock the full potential of artificial intelligence for every enterprise.\nAbout the Job\nFuriosaAI is seeking a Software Engineer to join our MLSys team. We apply deep expertise in model architectures and algorithms to build efficient, production-ready implementations of frontier LLMs tailored to our Tensor Contraction Processor (TCP) architecture.\nOur work makes these models available through FuriosaAI's software stack, enabling developers to deploy them efficiently on our NPUs with Furiosa-LLM (FLM). You will develop correct, efficient model kernels in Tensor Contraction Language (TCL), FuriosaAI's Python-based DSL for tensor computations, and work closely with the Inference Engine and Compiler teams on kernel implementation strategies and FLM integration.\nKey Responsibilities\nAnalyze model architectures, algorithms, and reference implementations to identify new model features and document their implementation requirements and trade-offs. Work with the Inference Engine and Compiler teams to agree on model implementation and integration strategies.\nDesign, implement, and optimize model-specific TCL kernels, including attention and mixture-of-experts computations, for high performance and efficient use of NPU resources.\nIntegrate new models and TCL kernels into Furiosa-LLM to enable correct, efficient inference.\nImprove the process for adding new models by building reusable analysis and integration tools, automating validation and benchmarking, and documenting repeatable workflows.\nValidate kernel and model correctness on NPUs against reference implementations, investigate numerical differences, and build regression tests for supported configurations.\nEvaluate techniques from frameworks such as vLLM and SGLang, adapt and apply relevant approaches to TCL kernels and Furiosa-LLM integration, and document validated findings.\nContinuously study state-of-the-art models to deepen expertise in model architectures and algorithms. Share insights across the company and provide technical guidance to teams on model capabilities, architectural trade-offs, and inference requirements.\nMinimum Qualifications\nDeep understanding of transformer-based LLMs, including attention variants, mixture-of-experts architectures, and KV-cache behavior.\nStrong Python programming skills and hands-on experience reading, modifying, and debugging model implementations in PyTorch or a comparable framework.\nHands-on experience implementing, debugging, and optimizing tensor operations or accelerator kernels, with an understanding of compute, memory, and numerical correctness.\nUnderstanding of LLM inference performance, including prefill/decode, batching, and latency-throughput trade-offs, with experience in quantitative performance evaluation.\nAbility to read and reason about Rust or C++ code when working on inference systems.\nClear technical communication and cross-team collaboration skills, including the ability to turn analysis into actionable engineering decisions.\nPreferred Qualifications\nExperience bringing up or optimizing models on GPUs, NPUs, TPUs, or other AI accelerators.\nFamiliarity with the internals of vLLM, SGLang, TensorRT-LLM, or similar inference frameworks, including scheduling, caching, or model parallelism.\nFamiliarity with ML compilers and optimizations such as fusion, tiling, and scheduling.\nExperience developing and optimizing accelerator kernels using CUDA, Triton, or a tensor DSL.\nExperience developing software in Rust, building model validation or benchmarking tools, or contributing to open-source model and inference projects.\nWhy Join FuriosaAI\nThe defining bottleneck of the AI era is building the right hardware and software stack to run it at global scale. Furiosa is solving this challenge holistically from the ground up.\nWith our flagship chip, RNGD, in mass production today and our next-generation platform in development with Broadcom, we are proving that full-stack, tensor-native compute is the future of AI infrastructure. This is a pivotal moment to join our team, right as we accelerate our global expansion.\nAt Furiosa, you will:\nSolve AI’s Most Urgent Challenge. Help build the high-performance, energy-efficient inference hardware and software required to fulfill the promise of advanced AI.\nPioneer Full-Stack Co-Design. Work with teams that are architecting solutions from silicon up through the compiler (featuring innovations like Tensor Contraction Language and Virtual ISA) and serving frameworks.\nShip Real-World Silicon, Software, and Solutions. Turn breakthrough technology into commercial deployment. RNGD is in mass production with TSMC and running live enterprise workloads for global leaders like LG AI Research and Samsung SDS.\nPartner With the Industry's Best. Collaborate across an elite global ecosystem that includes TSMC, Broadcom, SK Hynix, and GUC.\nDo Your Life’s Best Work. Join a brilliant, low-ego, mission-driven team in a high-trust environment that values autonomy, intellectual curiosity, and shared ambition. \nContact\n ","description_format":"text","description_chars":5612,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","AI Chips & Accelerators"],"lifecycle":[{"event":"open","at":"2026-09-18T04:06:37Z"}],"visa":[],"liveness":{"score":27,"band":"fade","label":"Fading","p_open":1,"p_active":0.595,"p_room":0.45,"age_days":58,"expected_fill_days":33,"reasons":["conf:3","velocity","win:tail"],"computed_at":"2026-11-15T07:52:55Z"},"pay":null,"html_url":"https://alion.io/job/furiosa-software-engineer-ai-model-enablement-inference","json_url":"https://alion.io/job/furiosa-software-engineer-ai-model-enablement-inference.json","meta":{"generated_at":"2026-11-15T15:39:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7448,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":31683},"rest":"https://alion.io/mcp/rest/get_company?id=31683"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffuriosa-software-engineer-ai-model-enablement-inference"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffuriosa-software-engineer-ai-model-enablement-inference"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffuriosa-software-engineer-ai-model-enablement-inference"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/furiosa-software-engineer-ai-model-enablement-inference\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffuriosa-software-engineer-ai-model-enablement-inference"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":1020010}},{"tool":"search_jobs","arguments":{"company":"furiosa.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":1020010},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}