You are signed in. Close

You are signed out. Close

Thank you. Your subscription has started. Close

Thank you. You will get an email when a new comic comes out. Close

We could not confirm your payment. If you paid, use the link "Sign in" at the bottom of the page. Close

Something went wrong on our side. Please try again in a moment. Close

Previous episode Gaming a metric: the number gets better while the goal gets worse

Goodhart's law: why a number stops telling the truth once it becomes a target

Goodhart's law: when a measure becomes a target, it stops being a good measure

A number that told the truth for years starts to lie the day a bonus rides on it, and nobody cheated. The economist Charles Goodhart saw the same thing at the Bank of England in 1975.

  1. 1 Miva won the bonus, riders are stuck, and nobody lied. Think back to before the bonus: nobody steered the time to close, so it rose and fell with the help riders got, and it told you how they were doing.the goaltime to closeMivaRono

    Miva won the bonus, riders are stuck, and nobody lied. Think back to before the bonus: nobody steered the time to close, so it rose and fell with the help riders got, and it told you how they were doing.

  2. 2 Once it paid, it followed the quickest road instead, lock open or not. The number still moved, but it no longer moved with the goal.the goaltime to closeMivaRono

    Once it paid, it followed the quickest road instead, lock open or not. The number still moved, but it no longer moved with the goal.

  3. 3 You're not the first to see it. In 1975, the economist Charles Goodhart, an adviser to the Bank of England, saw it with money. The Bank watched how much money was in the country, and once it tried to push that number, the number stopped moving the way it always had.Charles Goodhart, 1975the Bank of Englandamount of money

    You're not the first to see it. In 1975, the economist Charles Goodhart, an adviser to the Bank of England, saw it with money. The Bank watched how much money was in the country, and once it tried to push that number, the number stopped moving the way it always had.

  4. 4 Years later, the anthropologist Marilyn Strathern put the idea in the words people quote today. It still carries his name: Goodhart's law."When a measurebecomes a target,it ceases to bea good measure."Marilyn Strathern, 1997

    Years later, the anthropologist Marilyn Strathern put the idea in the words people quote today. It still carries his name: Goodhart's law.

  5. 5 So you look for a number that's harder to bend: 1 to 5 stars from the rider after each chat. From next month, the bonus pays for speed and stars. Two numbers can't both be gamed, can they?time to closestarsyou

    So you look for a number that's harder to bend: 1 to 5 stars from the rider after each chat. From next month, the bonus pays for speed and stars. Two numbers can't both be gamed, can they?

  6. Go further

    Where the two famous names first wrote about it.Goodhart's wordswere about money andstatistics: a patternin the numbers tendsto break once the Bankleans on it to steerStrathern's essaywas about Britishuniversities: the morea good grade wasexpected, the less ittold students apart

    Where the two famous names first wrote about it.

Next episode Unmeasured work: why the job no metric counts is the first to stop

Share this comic

More comics