How ChatGPT and other AI chatbots answer your question
Transformer: the "T" of ChatGPT, layer after layer
The "T" in ChatGPT means transformer. A transformer runs the same steps on your words again and again, in dozens of layers. Why is one pass not enough?
-
1
Yet the answer you get back is about watering your plant, the plant that "it" stands for.
-
2
In attention, though, "more" got only a bare "it": every token took its one look at the same moment. So how does "more" ever find out that you mean your plant?
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88