Overview
News
Technologies
Salaries
Products
People
Growth
Financials
Overview
RiftStack is an applied inference optimization lab. We make models run faster and cheaper through compiler and serving research.
News
Learning FlashAttention the Hard Way - Part 2
Part 2 takes Part 1's twisted monoid down to the metal: a generic compiler moveset walks one attention kernel from 25959µs to 206µs on an RTX 5090 - on par with FlashAttention-2 - with a measured number for every rung, the optimizations measurement refuse
Read more
Report
Learning FlashAttention the Hard Way - Part 1
FlashAttention looks like a bespoke GPU kernel, but it is not much different from a regular parallel reduction. Safe softmax becomes an associative reduction via denominator trick, Welford's variance, and flash attention is the same concept. This part is
Read more
Report
$1,000 Bug Bounty Offered To Fix GeForce RTX 5090 And RTX Pro 6000 Reset Issue
CloudRift.AI is offering $1000 to anyone who can fix the issue, or at least identify the root cause and reproduce the issue.
Read more
Report
Nvidia RTX 5090 reset bug prompts $1,000 reward for a fix - cards become completely unresponsive and require a reboot after virtualization reset bug, also impacts RTX PRO 6000
Nvidia's new RTX 5090 and PRO 6000 GPUs are reportedly being plagued by a reproducible virtualization reset bug that can leave the cards completely unresponsive.
Read more
Report
NVIDIA GeForce RTX 5090 and RTX 6000 PRO Plagued by the Virtualization Reset Bug
NVIDIA's top-end consumer GPU, the GeForce RTX 5090, and top-of-the-line ProViz SKU, the RTX 6000 PRO, have been plagued by a new virtualization bug. According to developers at CloudRift, who are creating a GPU cloud for AI developers, they have encounter
Read more
Report