You are signed in. Close

You are signed out. Close

Thank you. Your subscription has started. Close

Thank you. You will get an email when a new comic comes out. Close

We could not confirm your payment. If you paid, use the link "Sign in" at the bottom of the page. Close

Something went wrong on our side. Please try again in a moment. Close

Previous episode Transformer: the "T" of ChatGPT, layer after layer

How ChatGPT and other AI chatbots answer your question

Parameters: where an AI model keeps what it knows

An AI model is made of billions of numbers called parameters. Everything the model learned is stored in them. Where are these numbers, and what do they do to your words?

  1. 1 Hand layer 1 and layer 2 the same "it", and each one changes it its own way. The two steps are the same, so something else differs.it0.2−0.50.9layer 1layer 20.6−0.10.3−0.40.80.1example numbers

    Hand layer 1 and layer 2 the same "it", and each one changes it its own way. The two steps are the same, so something else differs.

  2. 2 So open a layer and look for what it knows about plants. You find no page, no sentence, not one word.youlayer 1?No page?No plant tips?

    So open a layer and look for what it knows about plants. You find no page, no sentence, not one word.

The rest of this episode is for subscribers

Subscribe to read every premium episode. You can cancel when you want.

Paid yearly: $99 instead of $119.88

Next episode AI training: how a language model gets its billions of parameters

Share this comic

More comics