Sean's Blog

Limits of Cognition

November 17, 2026
Edit on GitHub

The famous quote of Wittgenstein "The limits of my language mean the limits of my world." emphasizes the power language has on our cognition. But is it truly the limit of our cognition? Einstein is famously known for his thought experiments where he imagined himself flying along a light beam. So can our imagination transcend the limits of our thoughts in language?
So cognition is not limited by language, but cognition (and thus also language) is limited by imagination?

What is imagination then? Intuitive imagination happens in spacetime (3 space dimension and 1 time dimension) with a couple of dozens objects for the average human brain.

Can imagination actually produce knowledge before language, mathematics or formal reasoning can explain it?

Language forces continuous experience into discrete categories.

Language is abstract and compresses perception. So it always is a learned projection of our perception. Language is useful because it allows us to communicate thoughts and feelings.

AI Agents

LLMs "thoughts" are constrained by language currently.
But there is interesting work of passing vectors that represent inner states of these models between models as a richer alternative than discrete symbols (human language) to communicate thoughts between agents.

When a new generation of AI agents arrives that is not limited to think by human language anymore but can imagine any scenario in spacetime, we will reach a new level of AI that may truly deserve to be named AGI or ASI.

To illustrate the difference between language and world model based AI, lets see how this question would be answered: "What would happen if Earth's gravitational constant suddenly doubled?"
A language-based AI (LLM) will retrieve relevant physics knowledge and reason through the consequences in text.
A world-model-based approach would construct an internal simulation, change the gravitational parameter and observe the resulting dynamics.
(Though what about an LLM not answering from its internal language based physics knowledge but instead it running an external simulation it programs?)

#idea