{"id":108308,"url":"https://alion.io/job/sifive-staff-software-engineer-aiml-heterogeneous-systems","title":"Senior Software Engineer, AI/ML Heterogeneous Systems","company":{"id":58802,"name":"SiFive","domain":"sifive.com","url":"https://alion.io/company/sifive","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":95,"open_postings":21,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":72,"computed_at":"2026-10-22T06:10:10Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hsinchu, Taiwan"],"countries":["TW"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":29000,"max_usd":75000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2216},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"C++","optional":false},{"name":"CUDA","optional":false},{"name":"KV Cache","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"MLIR","optional":false},{"name":"OpenCL","optional":false},{"name":"Python","optional":false},{"name":"ROCm","optional":false},{"name":"SGLang","optional":false},{"name":"TGI","optional":false},{"name":"Triton","optional":false},{"name":"vLLM","optional":false},{"name":"LLVM","optional":true},{"name":"PyTorch","optional":true}],"status":"live","first_seen_at":"2026-05-15T00:00:00Z","employer_posted_date":"2026-10-05","last_verified_at":"2026-10-20T17:03:36Z","board_verified":true,"closed_at":null,"days_open":160,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":160},"description":"About SiFive\nAs the pioneers who introduced RISC-V to the world, SiFive is transforming the future of compute by bringing the limitless potential of RISC-V to the highest performance and most data-intensive applications in the world. SiFive’s unrivaled compute platforms are continuing to enable leading technology companies around the world to innovate, optimize and deliver the most advanced solutions of tomorrow across every market segment of chip design, including artificial intelligence, machine learning, automotive, data center, mobile, and consumer. With SiFive, the future of RISC-V has no limits.\nAt SiFive, we are always excited to connect with talented individuals, who are just as passionate about driving innovation and changing the world as we are.\nOur constant innovation and ongoing success is down to our amazing teams of incredibly talented people, who collaborate and support each other to come up with truly groundbreaking ideas and solutions. Solutions that will have a huge impact on people's lives; making the world a better place, one processor at a time.\nAre you ready?\nTo learn more about SiFive’s phenomenal success and to see why we have won theGSA’s prestigious Most Respected Private Company Award(for the fourth time!), check out ourwebsite andGlassdoor pages.\nJob Description:\nThe Role:\nJoin the SiFive AI/ML Software Team to build the high-performance stack for Next-Gen AI. We are seeking engineers to optimize and deploy LLMs and Generative AI models on RISC-V architectures, spanning from compiler infrastructure to distributed runtime systems.\nResponsibilities:\nHeterogeneous System Architecture: Design and implement the core compute programming model and device runtime daemon. You will define the orchestration of asynchronous task execution, managed memory hierarchies, and efficient host-device synchronization.\n\nInference Stack Integration: Lead the deployment of production-grade stacks like vLLM and SGLang on RISC-V. Optimize memory-bound operations, including PagedAttention and sophisticated KV-cache management, within a heterogeneous environment.\n\nKernel & Compiler Synergy: Enable seamless lowering from Triton/MLIR-based compiler to SiFive hardware-specific extensions. Develop high-performance kernels that push the limits of RISC-V Vector (RVV) and matrix compute units.\n\nCo-design: Collaborate with hardware architects to influence the design of future AI accelerators and micro-architectures.\n\nRequirements\nAt least 3 years working experiences in the relevant industry and field.\n\nEducation: MS/PhD in Computer Science, EE, or a related field.\n\nProgramming: Strong proficiency in C++ and Python.\n\nHeterogeneous Computing: Deep understanding of execution models for offloading compute (e.g., familiar with the concepts behind CUDA, ROCm, or OpenCL runtimes).\n\nAI Infrastructure: Practical experience with LLM serving internals (vLLM, SGLang, or TGI). Understanding of how frameworks interact with hardware backends.\n\nPreferred Qualifications\nRISC-V Enthusiast: Familiarity with RISC-V Vector (RVV) extensions and the RISC-V software ecosystem.\n\nCUDA Mastery: Deep experience with CUDA C++ and an understanding of the NVIDIA software stack internals.\n\nOpen Source Influence: Active contributor to vLLM, SGLang, PyTorch, or the LLVM/MLIR project.\n\n Additional Information:\nThis position requires a successful background and reference checks and satisfactory proof of your right to work in:\nTaiwanAny offer of employment for this position is also contingent on the Company verifying that you are a authorized for access to export-controlled technology under applicable export control laws or, if you are not already authorized, our ability to successfully obtain any necessary export license(s) or other approvals.\nSiFive is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.","description_format":"text","description_chars":3907,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":true,"languages":[]},"benefits":[],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Processors, MCUs & AI Chips","Semiconductor IP & Chip Design Services"],"lifecycle":[{"event":"open","at":"2026-05-15T00:00:00Z"},{"event":"close","at":"2026-09-12T02:02:32Z"},{"event":"reopen","at":"2026-10-05T10:05:13Z"}],"visa":[],"liveness":{"score":18,"band":"cold","label":"Long shot","p_open":1,"p_active":0.65,"p_room":0.28,"age_days":160,"expected_fill_days":72,"reasons":["conf:37","velocity","win:tail","crowd:brand"],"computed_at":"2026-10-22T06:10:10Z"},"pay":null,"html_url":"https://alion.io/job/sifive-staff-software-engineer-aiml-heterogeneous-systems","json_url":"https://alion.io/job/sifive-staff-software-engineer-aiml-heterogeneous-systems.json","meta":{"generated_at":"2026-10-22T15:05:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":14617,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-23T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58802},"rest":"https://alion.io/mcp/rest/get_company?id=58802"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsifive-staff-software-engineer-aiml-heterogeneous-systems"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsifive-staff-software-engineer-aiml-heterogeneous-systems"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsifive-staff-software-engineer-aiml-heterogeneous-systems"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/sifive-staff-software-engineer-aiml-heterogeneous-systems\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsifive-staff-software-engineer-aiml-heterogeneous-systems"}]}