Overview
News
Salaries
Products
People
Growth
Offices
Financials
News
Agentic Harness Archaeology
Dating the layers Most of what we call an agentic harness is a fossil. It is the shape a workaround took when an older model could not do something. The workaround hardened into architecture, got a name, and kept being defended long after the model learne
Read more
Report
On local inference
I woke up at 2 a.m. because the fans were screaming. The sound was different from the soft whoosh of a GPU under load. It was the high-pitched panic of a model that had swallowed its own context and was eating the swap file. I sat up for a second, then wa
Read more
Report
Hyperscalers are 4500 years old
You look at the Great Pyramid and the first thing that hits you is the physicality of their math. 2.3 million blocks, each weighing about 2.5 tons on average, quarried and moved into position over roughly 20 years. Then you look at a hyperscale datacenter
Read more
Report
A History of Local LLMs
Georgi Gerganov created llama.cpp on March 10, 2023, ten days after Meta released LLaMA, and showed that a 7-billion-parameter language model could run inference on a MacBook CPU without a GPU. First nobody had weights worth running. Then the weights exis
Read more
Report
