Martin Alderson

I know I'm guilty of just scanning OpenRouter's pricing tables and looking at input and output costs per million token. I've realised that's the wrong number to be focused on these days and cache read costs are actually far more important. Most of your sp

For the first time I can remember, I'm not choosing my daily driver models on raw intelligence. I'm choosing them on speed. Have we reached an intelligence tipping point? This is probably going to age like spoilt milk, but right now, models around the Opu

In the past few days Hugging Face announced a security incident, which transpired to be a "runaway" agent from OpenAI. This is likely the first known autonomous offensive agent working like this, and certainly the first known one where an agent has done t

This is the second article in a two part series focusing on what I believe is perhaps the least understood upcoming shift in AI economics. If you haven't read it yet, I'd recommend starting with part one. As always, if you enjoy my writing I'd love it if

This is a two part series focusing on what I believe is perhaps the least understood upcoming shift in AI economics. If you've enjoyed this, part two is now out here. And to be notified about future posts, please feel free to sign up for my newsletter. Th

While researching and writing my last article on the history of KV cache compression, it occurred to me while there has been so much implemented research on KV cache efficiency, actual model weights quantisation is still pretty blunt. This makes sense - a

While much is focused on the improvement of models, there's been radical improvements in the efficiency of KV cache compression. I was curious to figure out just how big the improvements are and why I think it matters so much. The headline figure: the mem

An unexpected development over the past few weeks is xAI's new partnerships with Anthropic and Google, providing them with a huge amount of capacity. It's worth remembering that xAI is now part of SpaceX, after the two merged back in February - so the rev

In the UK (and I'm sure elsewhere) politicians and commentators are falling over themselves to suggest that without huge fleets of datacentres built in the UK that we are going to be hopelessly left behind. I'm not convinced this is the case, and it risks

I joined Radical's "Built for Turbulence" podcast recently for a wide-ranging chat on what AI agents are doing to the economics of software. We got into whether 5 people with agents can really out-build a 500-person company, the "Figma Trap" where you end