How ChatGPT and other AI chatbots answer your question
Why an AI chatbot writes its answer one word at a time
AI chatbots show their answer a few words at a time, like a person who types. Is this only an effect on the screen? Or does the model really write while you watch? And how does it know when to stop?
-
1
And on your screen, the answer does not stop at "Check". The words keep coming, one after another, while you watch.
-
2
But one run of the model gave one list, and one draw took one token from it: "Check". So where do "the" and "soil" come from?
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88