Vincent Schmalbach

Provider routing can change an LLM's output when a request reaches a different model version, fallback model, parameter configuration, precision level, inference...Read More... Source

Large language model (LLM) inference is the process of producing output tokens from an input prompt. It uses floating-point arithmetic for matrix...Read More... Source

I pay for three Codex subscriptions at $200 each, and for the past week they have mostly bought me waiting. Since I switched from GPT-5.5 to GPT-5.6…

Give me a few hundred million dollars and a year and a half, and I will build you a pretty good LLM. Not a frontier model, but close. A few years ago that…

TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown copy with ads baked in that no…

GPT-5.6 Sol xhigh now uses more than twice as many tokens per session as GPT-5.5 xhigh in my Codex workflow. For Codex users, tokens per session means the total…

LLMs use Markdown tables all the time. A few months ago, Codex CLI displayed them as ordinary wrapped text. In a narrow terminal, the pipes and dashes were hard…

I tried to make AI writing sound more human with , an API setting that changes how likely a model is to select specific tokens. I built a blacklist from words…

I've built a lot of software, both my own side projects and client work as a freelancer. AI tools have made me much faster. Before AI, I spent much more time…

Incident response is the work of reconstructing and containing a breach after it happens. Hosted AI models can act as an elastic analysis layer when an…