How Large Language Models Work
Open the black box of large language models: how they predict text, why they sometimes make things up, and the handful of settings that change how they answer.
Prediction, tokens, and training
An LLM is a next-token prediction machine Strip away the marketing and a large language model does one deceptively simple thing: it looks at the text so far and predicts the most likely next token — a chunk that is often a word or part of a word. Then it adds that token to the […]
Reading a model announcement without being sold to
New models ship constantly. Most announcements will not change your work Keeping up is exhausting and mostly unnecessary. What you need is a filter that turns a launch post into a decision in five minutes. The four things that actually matter to you Price per token, input and output. This is the number most likely […]