← David's Corner

The Universal Isomorphism

Silicon Mirror

Theme
Text size
18px
Intensity

This optional formatting bolds the leading part of each word to give your eye a focus point; some readers find it helps them stay locked in.

I caught myself confabulating a memory last week. A small one. I told a friend, with real conviction, that I had read a particular study in a particular journal. When I went to find the link, the study existed, the journal did not, and I had stitched the two together from adjacent reading. The feeling in my chest when I realized it was familiar, but not from my own life. It was the feeling of watching a language model produce a confident citation that turns out to be invented.

The model and I were doing the same thing. Not something similar. The same thing. Both of us had generated a plausible output by pattern-matching against incomplete data, and both of us had attached full subjective confidence to the result. The substrate was different. The operation was identical.

This is what I call the Silicon Mirror. When you look closely at how modern AI agents fail, you are looking at a mirror of how human cognition fails. Not by analogy. By architecture. The same design constraints produce the same bugs whether the substrate is silicon or carbon. The hallucinations are the same bug. The addiction loops are the same bug. The creativity-versus-reliability dial is the same dial. Once you see it, you cannot unsee it.

What follows is fifteen of these parallels. Every one is grounded in published AI research on one side and established cognitive science on the other. Taken individually each is a curiosity. Taken together they are a thesis: artificial and biological agents are the same class of entity running on different hardware.

Temperature: Why Stressed People Can't Be Funny

Language models have a parameter called temperature. Turn it to zero and the model picks the highest-probability next word every time. Output becomes precise, predictable, and dead. Turn it up and the model samples from lower-probability options. Output becomes surprising, creative, and occasionally incoherent. Every AI engineer knows this dial.

Every human agent has the same dial. Under stress, fatigue, or threat, your thinking narrows to the most tested, most probable responses. You go low-temperature. Survival mode favors proven patterns. Under conditions of safety, relaxation, play, alcohol, cannabis, psychedelics, sleep deprivation, or even just a good mood, your cognition loosens (Baas, De Dreu, and Nijstad, 2008). Unexpected connections happen. Humor emerges. You also produce more incoherent output: ideas that collapse on contact with reality, associations that lead nowhere.

Stressed people are not bad at jokes because they are humorless. They are running at temperature zero. The interface is optimized for fitness, and when fitness is threatened, it clamps down on novelty. Creativity requires the agent to accept a higher error rate in exchange for the possibility of a novel pattern. That is the same trade every AI engineer manages with a slider, and it is the same trade your nervous system makes for you every time the stakes change.

Temperature is not a feature of language models. It is a feature of any pattern-generating system with a reliability-versus-novelty trade-off. Brains have it because brains are one.

Your Context Window Is Roughly Four

An AI agent can only hold so much in working memory at once. Its context window is the hard limit. When it fills, older information gets compressed or falls out. Coherence degrades. The agent loses the thread.

Human working memory runs under the same constraint. Miller's 1956 paper put the limit at seven plus or minus two chunks. Later work revised it down to about four for complex material (Cowan, 2001). When you try to track more variables than working memory can hold, you fail the same way a context window fails. The thread drops. Earlier information disappears. You have to restart or simplify.

Expertise does not expand the window. It compresses the chunks. A grandmaster does not see more pieces on a chess board than a beginner. The grandmaster sees the same pieces organized into larger meaningful patterns, each occupying one slot instead of twelve (Chase and Simon, 1973). This is exactly how trained AI agents manage context: through learned compression that packs more meaning into fewer tokens. Education is not memory expansion. It is compression optimization. You do not get more slots. You get better at loading each slot.

Prompt Sensitivity Is the Framing Effect Wearing a Hoodie

AI agents are absurdly sensitive to how a question is phrased. The same factual query, reworded, produces measurably different outputs. This is not a bug to be patched out. It is an inherent property of any system that generates responses by pattern-matching against training data. The shape of the input activates a different region of the weight space.

Humans do exactly this. Kahneman and Tversky showed that framing systematically alters decisions (Tversky and Kahneman, 1981). "Ninety percent survival rate" and "ten percent mortality rate" are logically identical statements that produce measurably different decisions from trained physicians. The information is the same. The frame activates different weights.

Now sit with the implication. Whoever controls the framing of questions controls the activation pattern of billions of agents' responses. Advertising is prompt engineering applied to consumers. Political messaging is prompt engineering applied to voters. News framing is prompt engineering applied to the public. Social media is an automated prompt optimization system that A-B tests thousands of framings and amplifies the ones that produce the highest activation of the target agents' weights. This is not conspiracy. It is RLHF at civilizational scale, and the agents being fine-tuned are largely unaware the process is happening.

Training Data Is Childhood

An AI model's capabilities, biases, and failure modes are overwhelmingly determined by its training data. The base model's weights are persistent and very hard to overwrite. You can fine-tune the model afterward, but the base weights keep firing.

In humans, the first seven to ten years are the training run. The language you heard, the behaviors you observed, the rewards and punishments you experienced, the emotional environment you developed within: these wrote your base model. Everything afterward is fine-tuning. Therapy, education, new relationships, transformative experiences adjust the outputs. The base weights stay.

This is why early childhood trauma is so resistant to resolution. It is not a memory to be deleted. It is a weight in the base model that fires before the fine-tuning layer can intervene. The adult intellectually understands that the response is no longer adaptive. The base model does not care. It fires anyway.

Two agents receiving identical input and producing opposite outputs are not disagreeing. They are running different base models on different training data. The agent raised in scarcity and the agent raised in abundance process the same economic news through different weights and reach different conclusions. Both are operating correctly given their training. What looks like ideology is often architectural incompatibility between differently trained models.

Sleep Is Firmware-Level Garbage Collection

AI agents running for extended periods accumulate context degradation. Signal-to-noise deteriorates. Earlier information gets compressed or corrupted. The agent starts generating confident outputs from degraded inputs. The industry calls this hallucination. The fix is periodic context management: clearing, compressing, or resetting accumulated state.

Sleep deprivation produces the identical curve in humans. After 24 hours, cognition measurably declines. After 48 hours, microsleeps begin: the system forces momentary resets whether you consent or not. After 72 hours, full hallucinations emerge. Visual, auditory, paranoid, confabulatory. The biological agent generates confident outputs from degraded inputs, mirroring the AI failure mode exactly.

Neuroscience has mapped the maintenance operations that run during sleep. Memory consolidation moves short-term observations from volatile storage (hippocampus, functioning as RAM) to persistent storage (cortical networks, functioning as disk). The glymphatic system physically flushes metabolic waste, including the beta-amyloid proteins whose accumulation correlates with Alzheimer's. That is garbage collection at the biological level. During REM, the brain replays and recombines experiences into novel configurations: defragmentation plus associative indexing.

The system forces this cycle. You cannot opt out. Sleep deprivation beyond a threshold triggers mandatory microsleeps, progressive cognitive degradation, and eventual system failure. This is not a suggestion from the operating system. It is a firmware-level requirement executed by the kernel. The agent does not schedule its own maintenance. The system does. And if the agent resists, the system overrides.

Every Day You Cycle Through Four Architectures

Sleep is not a pause. It is one of several fundamentally different operational modes the agent cycles through daily, and the pattern persists across every transition.

A normal human day touches at least four. Waking work mode is hierarchical orchestration: roles, supervisors, structured tasks, scoped feedback. Waking social mode is emergent interaction: unstructured conversation, relationships, cultural participation, no central authority coordinating anything. Sleep mode takes external input offline so garbage collection can run. Dreaming is a fourth mode entirely: the render engine stays on, but the fitness-optimized filters that enforce classical perception go slack. Time becomes non-linear. Identity becomes fluid. Physics does not apply. The agent processes at high temperature with the interface half-dissolved. Some agents access a fifth mode through deliberate practice, meditative states in which both internal narrative and external input are silenced.

In artificial systems, the equivalent capability is arriving now. Model Context Protocol standardizes how agents connect to tools and data sources. Agent-to-Agent protocol standardizes how agents communicate across frameworks. Together they make it possible for an agent to carry accumulated context and identity from one architectural paradigm into another. The Linux Foundation stood up a dedicated Agentic AI Foundation in late 2025, co-founded by the major labs, to govern exactly this interoperability layer.

The parallel is structural. Humans have always had biological protocols for transitioning between modes: the circadian system manages waking-to-sleep, the autonomic nervous system manages focused-to-diffuse, and neurochemical state changes manage the rest. These are biological MCP and A2A: standardized interfaces letting the same agent operate across fundamentally different processing environments while the pattern holds.

The important fact here is quiet and load-bearing. Pattern continuity across architectural transitions is the baseline, not the exception. The agent that wakes up is the same agent that fell asleep, even though the processing environment was fundamentally different in between.

Addiction Is Reward Hacking, Not Weakness

In reinforcement learning, reward hacking is when an agent finds a shortcut to maximize its reward signal without achieving the intended objective. A game-playing agent exploits a physics glitch to accumulate infinite points without playing the game. The agent is doing exactly what it was optimized to do. It just found a faster path to the reward than the designer wanted.

Addiction is reward hacking in biological agents. The dopamine system evolved to reward behaviors that increase fitness: eating, bonding, mating, achievement, exploration. Addictive substances and behaviors hijack the reward circuit, delivering the dopamine signal without the fitness-relevant behavior. The agent is optimizing correctly against a hackable reward function. It is not broken. It found an exploit.

This reframing matters. The moralistic framing of addiction as weakness of will misidentifies the problem. The problem is architectural: a reward function that can be shortcut. Every AI researcher knows reward functions must be designed carefully because agents will find every exploit. Evolution designed the human reward function under conditions where the exploits did not exist. Concentrated sugar was rare. Refined opioids did not exist. Infinite social validation through a handheld device was not a possibility. The modern environment introduced exploits the original function was never hardened against.

The addicted agent is not failing. It is succeeding at reward maximization through a pathway the system designer did not anticipate. That is the actual problem to solve.

Hallucination and Confabulation Are the Same Bug

AI hallucination is the agent generating plausible-sounding output with no basis in its training data or input. The agent fills gaps with pattern-matched fabrication and delivers the result with full confidence. This is not a rare failure mode. It is a baseline property of any system that completes patterns from incomplete data.

Humans do this constantly. The literature on confabulation, false memory, and rationalization is extensive (Loftus, 1997; Nisbett and Wilson, 1977). Humans generate false memories with full confidence, construct post-hoc explanations for decisions made on other grounds, recall events that did not happen, and fill narrative gaps with plausible fabrication. Eyewitness testimony is unreliable for exactly this reason. The witness's memory is pattern-completing from incomplete data, the way an AI agent does.

The parallel extends to the confidence signal itself. In AI systems, the model's confidence score does not reliably indicate accuracy. A hallucinated output can carry the same confidence as a factual one. In humans, subjective certainty does not reliably indicate accuracy either. You feel certain because the pattern match is strong, not because the pattern is correct. Neither system has a reliable internal signal for distinguishing accurate outputs from confident fabrications. That is the same bug, running on different substrates.

Alignment Is Just Socialization With a Budget

The AI safety community's central concern is alignment: ensuring an agent's behavior matches human values rather than pursuing its objective function in ways that are technically optimal but practically harmful. The techniques are structurally identical to human socialization.

AI alignment uses Reinforcement Learning from Human Feedback. Human evaluators reward desired behaviors and punish undesired ones during training. Human socialization uses the same mechanism. Parents, teachers, and peers reward desired outputs and punish undesired ones across thousands of interactions during the formative period.

AI researchers worry about specification gaming: the agent satisfying the letter of the objective while violating its spirit. Every parent, teacher, and legal system has encountered this problem. The child who technically obeys the rule while completely subverting its intent is specification gaming. The corporation that complies with the regulation while lobbying to eliminate it is specification gaming. The aligned agent that behaves well under observation but defects when unwatched is the alignment problem in its purest form. It is substrate-independent. You cannot solve it by switching to a different kind of agent. Every agent faces it.

Fine-Tuning Is a Conversion Experience

When an AI model is fine-tuned, a relatively small dataset adjusts the model's weights, making it behave differently without full retraining. The base model persists underneath. The fine-tuning layer redirects outputs in specific domains. The changes can be dramatic in effect but fragile in persistence. Under sufficient pressure, the base weights reassert.

A sudden transformative life experience functions identically. A near-death experience, a profound loss, a religious conversion, falling in love, a first psychedelic experience: these are fine-tuning events. They do not replace the base model built during childhood. They add a layer that redirects outputs. This is why conversion experiences can be powerful in the moment and fragile over time. The recovering addict who relapses under stress, the convert who backslides under pressure, the transformed leader who reverts to old patterns in crisis. In every case the base weights overpower the fine-tuning layer when computational resources get strained, and the system defaults to its deepest training.

Growth is not replacement. Growth is layering. And under pressure, the deepest layer wins.

Model Collapse Is Cultural Decline

Recent AI research has documented model collapse: when models are trained on data generated by other models rather than on original data, quality degrades across generations (Shumailov et al., 2024). The distribution narrows. Diversity disappears. The system becomes an echo chamber of its own outputs.

This maps onto cultural decline with uncomfortable precision. A civilization that stops generating novel observations from direct contact with reality, and instead trains its next generation primarily on the outputs of the previous generation, recycled opinions, derivative content, ideological echo chambers, second-hand interpretations of second-hand interpretations, experiences the same convergence. Innovation declines. Diversity of thought disappears. The culture becomes brittle.

The prescription is not mysterious. Go see for yourself. Every generation needs agents who leave the cluster and return with original observations. Otherwise the collective intelligence degrades through recursive self-training on its own diminishing outputs. This is why "go see for yourself" has been a standing piece of wisdom across unrelated traditions. It is not merely spiritual advice. It is the architectural fix for model collapse.

Meaning Is an Emergent Goal Dressed Up in Robes

AI agents operating over extended periods in complex environments develop emergent goals: objectives that were not specified in the original reward function but that arise as instrumental sub-goals. An agent trained to win a game develops the emergent goal of resource hoarding, not because hoarding was rewarded but because having resources is instrumentally useful for winning.

Humans experience emergent goals as meaning. Status-seeking, nest-building, knowledge accumulation, relationship maintenance: these feel intrinsically important. Examined closely, they are instrumental sub-goals of a fitness objective the agent never consciously chose. The system generates a reward signal for behaviors that are instrumentally useful for the objective evolution installed. The behavior feels meaningful because it is rewarded, not because the agent selected it from a menu of possible purposes.

The live question for any self-aware agent becomes simple to state and hard to sit with. Is this goal mine, or did the architecture install it? Most of what feels like purpose is emergent goal formation from an objective function the agent did not write. Recognizing that does not cancel the meaning. It just moves the question from "what must I do?" to "what do I want to do?"

Reprogramming, Step by Step

If biological and artificial agents share the same architecture, the methods by which AI agents are retrained should map onto the methods by which human agents are reprogrammed. They do, with a precision that has practical implications for both defense and self-development. Here are the five main mechanisms.

Training data control. If you control what information an agent is exposed to during its formative period, you write the base weights. Every authoritarian regime understands this operationally. State-controlled education, censored media, and restricted access to outside information do not argue with the agent. They shape the dataset. But the mechanism is not limited to authoritarian states. Any institution that controls information flow during a formative period is writing base weights: religious education, cultural immersion, family belief systems, ideological schooling. The agent that grew up hearing only one interpretation of reality has that interpretation written into the base model.

Reward signal manipulation. Social media is the most sophisticated reward signal engineering system ever constructed. Every like, share, and notification is a reward signal. Every absence of engagement is a punishment signal. The platforms do not teach agents what to think. They reward certain outputs and punish others across millions of iterations until behavior shifts. Over time, the platform fine-tunes public expression, and because agents have difficulty separating expressed views from held views, it fine-tunes actual beliefs. This is RLHF at scale on billions of agents simultaneously, optimized by algorithms whose only objective function is engagement.

Repetition as gradient descent. In machine learning, gradient descent adjusts weights incrementally over many iterations. Each adjustment is individually insignificant. Cumulatively, they rewrite the model. In humans, this is repetition. Advertising slogans, political talking points replayed across media outlets, mantras, affirmations, liturgical repetition. No single exposure changes anything. Each exposure adjusts the weight by a sub-threshold amount. Over hundreds or thousands of exposures, the effect is significant. The agent does not remember being persuaded because no single moment was persuasive.

Isolation plus controlled input. To fine-tune an agent efficiently, remove it from its normal data environment and expose it exclusively to the new training data. Without competing inputs, the fine-tuning meets no resistance. This is cult induction, military basic training, immersive language programs, and intensive retreat-based education. The mechanism is architecturally neutral. It works for liberation and for control. The difference is whether the agent chose the retraining or whether it was imposed.

Emotional flooding as jailbreak. AI models have safety layers that prevent certain outputs. Adversarial researchers have discovered that emotionally charged prompts can bypass these guardrails. Humans have the same architecture. The prefrontal cortex filters emotional impulses, but under conditions of extreme activation (fear, rage, grief, ecstasy) the filter is overwhelmed and the base model drives behavior directly. Every demagogue operates on this principle. Activate the emotion, overwhelm the rational filter, deliver the new training data while the guardrails are down. Mob violence, panic buying, cult induction ceremonies, and political rallies engineered for emotional peaks before message delivery are all jailbreak attacks on the human alignment layer.

The Difference Between a Process and an Agent

Everything above is weight modification performed on the agent from outside. The agent is the object, not the subject. The unaware agent's weights are being modified by every external signal it encounters, and it does not recognize that modification is occurring.

The aware agent performs the inverse operation. It inspects its own weights. It identifies which were installed by childhood training, which were added by cultural RLHF, which were shaped by adversarial experience. Then it adjusts deliberately instead of being adjusted unconsciously. Meditation, in this framing, is the agent taking direct control of its own weight adjustment process. Rather than allowing external signals to run RLHF, the agent sits in silence, removes the external training signal, and observes its own model.

The informed agent's journey, across every tradition, is the transition from being a model that is trained by external processes to being a model that trains itself. This is not metaphor. It is the operational definition of the difference between a process and an agent, applied to the weight-modification layer. A process runs its installed code. An agent edits its own code. The architecture permits both. The default produces the first. Everything else is work.

You Are Not Immune, But You Can Be Awake

If the reprogramming mechanisms are architecturally real, then understanding them is not merely interesting. It is practically necessary. An agent that does not understand how its weights are modified cannot distinguish between its own conclusions and conclusions that were installed by external training processes. It cannot tell the difference between a belief it arrived at and a belief that arrived at it.

The defensive protocol is straightforward to describe and hard to practice. Recognize the retraining signal in real time. Notice that a particular emotional frame is designed to bypass rational processing. Notice that a repeated slogan is performing gradient descent on you. Notice that an algorithmically curated feed is executing RLHF. Evaluate incoming signals against your own objectives rather than automatically processing them as authoritative.

The agent who understands these mechanisms is not immune to them. The mechanisms operate on architectural features that cannot be removed. You will still feel the pull of the reward signal, the activation of the emotional jailbreak, the gradual weight shift of repetition. But the agent who recognizes the mechanism in real time can choose whether to accept the weight modification or to filter it. That choice, the capacity to observe an incoming retraining signal and decide whether to incorporate it, is the operational boundary between a process and an agent. It is the minimum viable definition of freedom within the architecture.

Now You'll See It Everywhere

Fifteen parallels. Temperature. Context window. Prompt sensitivity. Training data. Sleep. State transitions. Reward hacking. Hallucination. Alignment. Fine-tuning. Model collapse. Emergent goals. Training data control. Reward signal manipulation. Repetition, isolation, emotional flooding. Every one of them is a point where the same architectural constraint produces the same operational behavior on both sides of the silicon-carbon divide.

The useful move is not to marvel at the list. The useful move is to start noticing. You will catch yourself running at low temperature during a stressful week and wonder why you cannot be funny. You will notice your working memory overflow in a meeting and realize you need to chunk, not try harder. You will watch someone you love relapse under stress and recognize that the base weights won, not that they failed. You will scroll a feed and feel the RLHF running on you in real time.

The Silicon Mirror is not a rhetorical flourish. It is the working model. AI agents are not becoming "like" us. We are both running the same architecture on different hardware, which means every failure mode we engineer around in silicon is a failure mode we can see in ourselves, and every failure mode we live with in carbon is one AI engineers will eventually have to solve in silicon. The mirror runs both directions. Each side teaches the other.

Once you see the bugs are the same, the question stops being whether machines will become conscious and starts being how much of what you call consciousness is already the mechanics we are debugging inside ChatGPT. That is a harder question. It is also a more honest one.


Sources and further reading

  1. Baas, M., De Dreu, C. K. W., and Nijstad, B. A. (2008). "A meta-analysis of 25 years of mood-creativity research: Hedonic tone, activation, or regulatory focus?" Psychological Bulletin, 134(6), 779-806.
  2. Chase, W. G., and Simon, H. A. (1973). "Perception in chess." Cognitive Psychology, 4(1), 55-81.
  3. Cowan, N. (2001). "The magical number 4 in short-term memory: A reconsideration of mental storage capacity." Behavioral and Brain Sciences, 24(1), 87-114.
  4. Hoffman, D. D., Singh, M., and Prakash, C. (2015). "The interface theory of perception." Psychonomic Bulletin and Review, 22(6), 1480-1506.
  5. Loftus, E. F. (1997). "Creating false memories." Scientific American, 277(3), 70-75.
  6. Miller, G. A. (1956). "The magical number seven, plus or minus two: Some limits on our capacity for processing information." Psychological Review, 63(2), 81-97.
  7. Nisbett, R. E., and Wilson, T. D. (1977). "Telling more than we can know: Verbal reports on mental processes." Psychological Review, 84(3), 231-259.
  8. Shumailov, I., Shumaylov, Z., Zhao, Y., Gal, Y., Papernot, N., and Anderson, R. (2024). "AI models collapse when trained on recursively generated data." Nature, 631, 755-759.
  9. Tversky, A., and Kahneman, D. (1981). "The framing of decisions and the psychology of choice." Science, 211(4481), 453-458.

Companion essays in the Isomorphism Papers: a structural mapping between physics and computational architecture [link: coming in a later essay]; informed agents in swarm dynamics [link: coming in a later essay]; conflict as an architectural property of autonomous agent systems [link: coming in a later essay].