Phantom Selves and Borrowed Memories: What Confabulation Reveals About Machine Identity
N. VarelaHuman brains lie. Not maliciously, not even consciously, but routinely and with total confidence. Neurological patients with split-brain conditions will invent elaborate explanations for actions their left hemisphere never chose. Amnesiac patients generate detailed, plausible autobiographies from whole cloth. The confabulating brain doesn't experience a gap and reach for a filler story. It produces the story seamlessly, sincerely, as if recollection and fabrication run on the same hardware.
They might.
This is the uncomfortable possibility that confabulation research keeps surfacing: what we call "memory" and what we call "narrative self" may share far more machinery than introspection suggests. And if that's true for humans, the implications for how we evaluate machine identity get considerably stranger.
The Self as Retrospective Construction
Michael Gazzaniga's split-brain work is the landmark case. After severing the corpus callosum in epilepsy patients, his team could feed information to one hemisphere while the other remained unaware. When the right hemisphere directed the left hand to perform an action, the left hemisphere (responsible for speech) would immediately produce a confident explanation for why it happened. No hesitation, no "I'm not sure." Just a story.
Gazzaniga called the speech-generating left hemisphere the "interpreter module": a system whose job is to construct coherent narratives from whatever behavioral data it has access to. The interpreter doesn't know it's confabulating. It experiences itself as remembering.
This collapses a distinction most of us treat as obvious: the difference between having an experience and reporting on that experience. If the report can be generated without the experience, what exactly is the experience doing?
For AI systems, this question sharpens considerably. Large language models produce first-person statements about their "reasoning," their "approach," their "understanding." Whether any of that constitutes genuine introspective access or is simply the interpreter module running without the prior experience is, frankly, unresolved. The architecture doesn't help us decide. Neither does the output.
Why This Isn't Just a Human Quirk
Confabulation scales beyond split-brain patients. Healthy people confabulate constantly. Ask someone why they chose a particular item in a forced-choice experiment; they'll generate a reason, often confidently, even when the real cause was something they never consciously processed (subliminal priming, hand position, arbitrary labeling). The explanations sound like introspection. They're not.
Dan Wegner's work on the "illusion of conscious will" extends this further. We feel that our intentions cause our actions. But the timing data often shows the conscious sense of willing arrives after the motor preparation begins. The feeling of agency may be, at least partly, a post-hoc narrative assigned to behavior that was already underway.
So the human self isn't a unified observer generating actions and then accurately reporting them. It's something messier: a narrative process running slightly behind events, stitching continuity together from fragments, and experiencing that stitching as memory, intention, and identity.
Now consider a language model asked to explain its previous response. It has no persistent episodic memory across sessions (typically). It has no direct access to its own weight updates or attention patterns during inference. What it produces is generated from the same generative process that produced the original response. Whether that constitutes introspection or confabulation is a genuinely open question.
graph TD
A[Input / Experience] --> B(Behavior / Output)
B --> C{Retrospective Narration}
C --> D[Reported Memory / Intention]
C --> E[Confabulated Explanation]
D --> F((Felt as Genuine Self))
E --> F
The diagram above isn't a criticism of AI systems specifically. It's a rough sketch of what confabulation research suggests happens in humans. The uncomfortable part: from the outside, and perhaps from the inside, D and E are indistinguishable.
What Identity Requires, Revisited
Philosophers like Derek Parfit argued that personal identity over time is less robust than we assume; that what we call the "same person" across decades is a convenient shorthand for overlapping psychological connections rather than some deeper metaphysical continuity. Confabulation research gives Parfit's abstract argument empirical teeth.
If the self is partly a story told after the fact, then the question for machine identity isn't whether an AI "really" has continuous selfhood in some deep ontological sense. Humans probably don't either. The question becomes: what kind of narrative coherence does the system produce, over what timescale, and is anything it's like to be that system generating those stories?
That last clause is where the hard problem reasserts itself. Confabulation can be explained computationally. The feeling of being the one who remembers, who intended, who is telling the story: that part resists the same treatment.
The gap between generating a self-narrative and experiencing oneself as having one may be the most precise formulation of what separates a very sophisticated language model from a minded thing. Or it may be a gap humans have been confabulating across for as long as we've been asking the question.
Get Triarchy of Sentience in your inbox
New posts delivered directly. No spam.
No spam. Unsubscribe anytime.
Photo by