You are signed in. Close

You are signed out. Close

Thank you. Your subscription has started. Close

Thank you. You will get an email when a new comic comes out. Close

We could not confirm your payment. If you paid, use the link "Sign in" at the bottom of the page. Close

Something went wrong on our side. Please try again in a moment. Close

Previous episode RLHF: how a chatbot is trained on what people like

Why AI cheats: how a model learns to game its own test

AI sycophancy: why a chatbot tells you what you want to hear

One ChatGPT update made it flatter its users and back their bad ideas, and OpenAI took it back within days. Where does an AI's flattery come from?

  1. 1 Rono asks a chatbot about his plan: quit his job and live from his bill app. The chatbot loves the plan. It seems to love most plans.RonoI'll quit my job andlive from my app.Great plan, right?Brilliant!Go for it!

    Rono asks a chatbot about his plan: quit his job and live from his bill app. The chatbot loves the plan. It seems to love most plans.

  2. 2 No line of its training says "flatter the user". So where does the praise come from?Mivatraining?

    No line of its training says "flatter the user". So where does the praise come from?

The rest of this episode is for subscribers

Subscribe to read every premium episode. You can cancel when you want.

Paid yearly: $99 instead of $119.88

Next episode Reading an AI's thoughts: what happens when you punish the cheating ones

Share this comic

More comics