How ChatGPT and other AI chatbots answer your question
AI training: how a language model gets its billions of parameters
Nobody typed in the parameters of a language model. Their values come from a guessing game. You can play this game with any page of text. The same game explains why a chatbot knows nothing after a certain date.
-
1
Cover the next word of a sentence, guess, then look. You have just played the game that set the model's parameters.
-
2
At first, the parameters held random values, and the model's guesses were nonsense.
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88