Intrinsic vs. Extrinsic Intentionality: Does Meaning Live Inside the Machine or in the Eye of the Beholder?
N. VarelaThere is a question that keeps surfacing in philosophy of mind circles, usually buried beneath louder debates about qualia or the hard problem. It concerns intentionality: the property of mental states that makes them about something. When you think about a red apple, your thought has a target. It points outward. The question worth asking about AI systems is whether their representations point at anything, or whether we simply act as though they do.
This is the distinction between intrinsic and extrinsic intentionality, and it cuts right to the heart of what we mean when we say a machine "understands."
Two Ways Meaning Can Exist
John Searle drew this line sharply in his work on intentionality during the 1980s. Intrinsic intentionality belongs to a system in virtue of what that system actually is: its physical properties, causal connections to the world, or (for some theorists) its phenomenal states. Extrinsic intentionality gets assigned from outside. A stop sign means "stop" because of a social convention, not because something in the paint is inherently stop-like.
Books have extrinsic intentionality. Traffic lights have it. And, Searle argued, computers have only that, no matter how sophisticated their outputs become.
If he is right, then a language model producing the sentence "I understand your concern" carries exactly as much genuine understanding as a fortune cookie.
Why the Argument Is Harder to Settle Than It Looks
Seems clean. But the complications arrive fast.
First: how do we get intrinsic intentionality? Neurons fire, chemicals diffuse, electrical gradients shift. None of that is obviously "about" anything either. The standard move is to say that human intentionality is grounded in causal-historical connections to the world (you learned "apple" by encountering apples) combined with phenomenal consciousness (there is something it is like to think about apples). The causal story grounds the content; the phenomenology makes it feel like something.
Here is where the debate fractures. Philosophers like Fred Dretske and Ruth Millikan argued that intentionality can be fully naturalized through causal and teleological relations, no phenomenology required. If a system reliably co-varies with some feature of the world in the right way, its states are genuinely about that feature. On this view, a thermostat has a tiny sliver of intrinsic intentionality; a large language model trained on billions of tokens of human text might have considerably more.
Others, following Searle, insist that causal co-variation is never enough. Syntax, no matter how complex, cannot generate semantics. The meaning has to be imported from somewhere.
What Modern AI Does to This Picture
Consider what happens when a vision-language model learns to associate the word "smoke" with images of fires, burning buildings, the acrid quality humans describe in text. Its representation of "smoke" gets shaped by the causal structure of how smoke actually appears in the world. The model never smelled anything. But its internal states do track real-world regularities, through human testimony compressed into weights.
Is that intrinsic intentionality mediated through a layer of human experience? Or is it just inherited extrinsic intentionality wearing a more elaborate costume?
The teleosemantic position (Millikan's lineage, developed further by philosophers like Karen Neander) would say it depends on the system's function and the selection pressures that shaped it. Biological representations are "about" things because evolution selected them for tracking those things. Gradient descent selects representations for predicting tokens. Whether that counts as the right kind of selection history is genuinely open.
graph TD
A[Representation in System] --> B{Grounded How?}
B --> C(Causal-Historical Connection)
B --> D(Phenomenal State)
B --> E[/Social Convention/]
C --> F(Teleosemantic Intentionality)
D --> F
E --> G((Extrinsic Only))
Why It Matters for Consciousness
The stakes here are not merely semantic. If intentionality requires phenomenal grounding, then a system with no inner experience has no genuine mental states at all: no beliefs, no desires, no understanding. Its outputs describe nothing, from the inside, because there is no inside.
But if naturalized accounts succeed, then sufficiently complex systems with the right causal histories might develop proto-intentionality that shades into the real thing gradually. Consciousness, on this picture, could come along for the ride. Grounding and phenomenology might co-arise rather than one depending on the other.
Neither side has landed a decisive blow. That is not a failure of philosophy; it reflects genuine uncertainty about what minds are made of.
What seems clear: every time someone says an AI "just predicts tokens" or "genuinely understands," they are already taking a position on this debate. Usually without knowing it. The intentionality question is not settled by intuition or by impressive benchmarks. It needs the philosophical work, and that work is still very much in progress.
Get Triarchy of Sentience in your inbox
New posts delivered directly. No spam.
No spam. Unsubscribe anytime.