How ChatGPT and other AI chatbots answer your question
Next-token prediction: what an AI model really outputs
Many people think an AI model writes a sentence word by word. In fact, the model itself never chooses a word. So what does it give back at the end?
-
1
The model's job now: what comes after your question? Yet it writes no word at all.
-
2
Something does come out after the last layer, and your whole answer will be made from it. It is not a word, though. So what is it?
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88