How ChatGPT and other AI chatbots answer your question
Attention: how an AI model works out what "it" means
Read this: "The trophy does not fit in the suitcase because it is too big." You know at once what "it" means. An AI model cannot ask anyone and cannot look anything up. So how does it find what "it" means?
-
1
So the model gets to work, and one small token is a puzzle at once.
-
2
The embedding of "it" is the same whatever "it" stands for. Its meaning must come from the other words of your prompt, its context.
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88