Why does AI forget what you just said? — Memory limits
If it matters, say it again.
1 · Think first
AI doesn't store a chat the way your brain does. Every time, it rereads the whole conversation so far from the top, then answers.
But how much it can read at once (its context length) has a limit, so when a chat gets long, the early part gets pushed out.
So for anything really important, bringing it up again later in the chat helps the AI and you.
2 · Experiment · Context window tracker
Try it — context window tracker
See for yourself how old messages get pushed out as a chat goes on.
There are only 4 slots. As the chat goes on, the oldest message gets pushed out first. Mention a pushed-out one again and it comes back in.
Figure
In one picture
The window has a fixed size. When a new message comes in, the oldest one gets pushed out.
3 · Quiz
Quick check
Three questions. Pick an answer and it's marked right away, with the reason why.
Today in one line
Today in one line
If it matters,
say it again.
Learn more
- How much an AI can read at once is called its context length, and lots of research is trying to make it longer — Lost in the Middle: How Language Models Use Long Contexts