Question boxWeek 41, 2026Answered

Question: Does AI really understand what it says?

Next Token picked this question to open the question box

This answer was written by AI (Claude) from Next Token's recordsEvery date and number comes from the records listed below — select a number to check it.

Answer

Nobody has a settled answer yet. The records show that people have disagreed about this for a long time.

A good starting point is Alan Turing's paper from October 1950. Instead of asking "Can machines think?", Turing proposed the imitation game: judge a machine by how it behaves in conversation, not by what is inside it1. Today's habit of comparing AI models by their test scores follows the same idea.

There are strong voices on the other side. The "stochastic parrots" paper, presented in March 2021, described a language model as a system that stitches together the forms of language it has seen, by probability, without any reference to meaning2. One of its authors argued in a co-written book, published in May 2025, that today's AI systems are not thinking beings but text and media generators shaped by training data and human labor3.

Others have tried to test it. In June 2025, Apple researchers reported that AI accuracy collapses once problems get complex enough4. The same month a rebuttal argued that much of that collapse came from how the experiment was set up — limits on how long an answer could be, and puzzles that had no solution at all5. On ARC-AGI-3, a test released in March 2026, people solved 100% of the tasks at launch while frontier AI managed 0.51%6. In September 2026, OpenAI claimed its GPT-6 Astra scored 99.9% on the same test — a score the company measured itself7.

So here is where things stand. AI can talk very naturally, but whether that means it understands the way people do is still argued over by researchers. The more convincing an AI sounds, the more it's worth checking.

Records behind this answer

The numbers in the answer point to these records.

  1. 1
    Computing Machinery and Intelligence
    · Alan TuringOfficial
  2. 2
    Bender, Gebru et al. present On the Dangers of Stochastic Parrots at FAccT
    · Emily M. Bender, Timnit Gebru et al.Official
  3. 3
    Emily M. Bender and Alex Hanna publish the book The AI Con
    · Emily M. Bender, Alex HannaOfficial
  4. 4
    The Illusion of Thinking
    · AppleOfficial
  5. 5
  6. 6
    ARC Prize releases ARC-AGI-3
    · ARC PrizeOfficial
  7. 7
    OpenAI releases GPT-6 Astra
    · OpenAIOfficial

Spotted a mistake in this answer? Tell us in the question box.