You are signed in. Close

You are signed out. Close

Thank you. Your subscription has started. Close

Thank you. You will get an email when a new comic comes out. Close

We could not confirm your payment. If you paid, use the link "Sign in" at the bottom of the page. Close

Something went wrong on our side. Please try again in a moment. Close

Previous episode Next-token prediction: what an AI model really outputs

How ChatGPT and other AI chatbots answer your question

Sampling: why AI gives a different answer to the same question

Send an AI chatbot the same question two times. You can get two different answers. Yet no parameter of the model changed between the two.

  1. 1 This time, Miva skips the search engine and sends the very same question to the chatbot. Her answer starts another way.Check thesoil first.youNotnecessarily.Miva

    This time, Miva skips the search engine and sends the very same question to the chatbot. Her answer starts another way.

  2. 2 Yet the model gave you both the same list: same prompt, same parameters. The difference comes after the list.the modelSame list foryou both!Check34%Not14%Before10%example numbers

    Yet the model gave you both the same list: same prompt, same parameters. The difference comes after the list.

The rest of this episode is for subscribers

Subscribe to read every premium episode. You can cancel when you want.

Paid yearly: $99 instead of $119.88

Next episode Why an AI chatbot writes its answer one word at a time

Share this comic

More comics