How AI agents work: an AI that can only write, and still gets things done
Context window: what happens when an AI agent's work stops fitting
At every step, an AI agent reads everything again: its list of tools, your whole chat and every result. A long task makes this text longer and longer. But the context window has a fixed size. What happens when the work does not fit anymore?
-
1
Each round, the model reads one long text: the list of 40 tools on top, then the whole chat. This morning, you wrote in it: Rono cannot eat nuts. Then the planning began.
-
2
Every tool result is pasted in and stays there, round after round. One web page of recipes, fetched by the web tool, is longer than everything you typed all day.
The rest of this episode is for subscribers
Subscribe to read every premium episode. You can cancel when you want.
Paid yearly: $99 instead of $119.88