Overview
News
Technologies
Salaries
Products
People
Growth
Financials
Overview
About Me:. My name is Raphael Pisoni. I am a Machine Learning Researcher but my path was not a straight line.
News
A Few Gaussians Is All You Need: SSOG-Attention That Steers Instead of Scores
I swapped the transformer's matchmaking service for a handful of Gaussians, and it beat content scoring without comparing a single pair of tokens. Crack open any vision transformer and you'll find the same machinery humming at its core: scaled dot-product
Read more
Report
Soap Bubbles and Attention Sinks: The Theory and History of the HALO-Loss
The standard Cross-Entropy loss has a well-known flaw: it forces neural networks to push their features toward infinity just to reach full confidence. The result is a messy latent space and models that confidently hallucinate when fed absolute garbage dat
Read more
Report
Scaled RBF Attention: Trading Dot Products for Euclidean Distance
If you crack open the architecture of almost any modern Transformer, you will find Scaled Dot-Product Attention (SDPA) sitting at its core. We rarely second-guess it. It is heavily optimized by hardware accelerators, it scales beautifully, and empirically
Read more
Report
Geometric Alignment via Teacher-Free Self-Distillation
The "Infinite Gap" and Why Softmax Keeps Me Up at Night To understand any solution, we first have to really understand the problem. I've spent the better part of my research career staring at loss curves, watching them dip, plateau, and occasionally spike
Read more
Report
Decoupling Features and Classes with Self-Organizing Class Embeddings
Classification with neural networks is weird! There, I said it! We usually have a single output per class, as if for some reason each class was it's own feature. The numbers these outputs produce are then intepreted as a log-probability distribution over
Read more
Report
Pro access
Upgrade to see all 10 mentions
Upgrade to a paid plan to read every media mention of this company - funding news, awards, product launches and press releases from all the outlets writing about it.
Every media mention and press release
Funding news, awards and product launches
Fresh coverage from every outlet writing about the company
Upgrade now
Cancel anytime. Secure checkout. Instant activation.