You are signed in. Close

You are signed out. Close

Thank you. Your subscription has started. Close

Thank you. You will get an email when a new comic comes out. Close

We could not confirm your payment. If you paid, use the link "Sign in" at the bottom of the page. Close

Something went wrong on our side. Please try again in a moment. Close

Previous episode Clickbait vs watch time: why YouTube stopped trusting the click

How TikTok and YouTube decide what you see next

Embeddings: how a video feed turns you and every video into numbers

The program that picks your next video does not watch it. Instead, it turns every video, and you too, into a list of numbers called an embedding. How can numbers tell which videos you will like?

  1. 1 The program behind the feed, the recommender, never looks at the clay. It gives each video a list of numbers instead. A chatbot does the same for words, and the list has the same name: an embedding.0.82−0.410.150.66the embedding ofMiva's videoexample numbers

    The program behind the feed, the recommender, never looks at the clay. It gives each video a list of numbers instead. A chatbot does the same for words, and the list has the same name: an embedding.

  2. 2 Nobody types these numbers. They are worked out from what millions of people watched, so videos watched by the same people get close lists. Two pottery videos sit close, and football far away.0.82−0.410.150.79−0.360.20−0.700.58−0.33closefarexample numbers

    Nobody types these numbers. They are worked out from what millions of people watched, so videos watched by the same people get close lists. Two pottery videos sit close, and football far away.

  3. 3 You get a list too, built from the lists of the videos you watched. Your two views of Miva's bowl pull your list toward pottery.youyour list

    You get a list too, built from the lists of the videos you watched. Your two views of Miva's bowl pull your list toward pottery.

  4. 4 Draw each list as a point, and you get a map where near means alike. You stand right beside the pottery videos, and far from football.potterybeescookingfootballyou

    Draw each list as a point, and you get a map where near means alike. You stand right beside the pottery videos, and far from football.

  5. 5 Millions of videos have their point on this map, and your thumb will swipe again in a second or two. The app cannot watch them all for you. So which ones does it even look at?millions of videos?

    Millions of videos have their point on this map, and your thumb will swipe again in a second or two. The app cannot watch them all for you. So which ones does it even look at?

  6. Quick check

    A friend who watches cooking.A friend has watchedonly cooking videos.Where is their pointon the map?

    A friend who watches cooking.

    Show the answer

    Near the cooking videos. Their list is built from the lists of the videos they watched.

  7. Go further

    How long a real list is, and what else goes into yours.hundreds of numbersa real list holds hundredsof numbers, not two: themap is drawn flat so it fitson a pageyour searchesYouTube's 2016 paper buildsyour list from the videosyou watched, and also fromthe words you searched

    How long a real list is, and what else goes into yours.

Next episode Candidate generation: how a video feed finds a few hundred videos among millions

Share this comic

More comics