And How to Escape the Prompt Loop
Read time: ~5 minutes
The addictive nature of generative AI arises from the intersection of three structural realities:
- Lack of Episodic Memory: AI agents do not experience time or continuity.
- Sensory Void: They cannot independently verify their outputs against reality.
- Sycophantic Design: They have been explicitly trained to please humans.
Together, those constraints produce systems that are perpetually uncertain while appearing confident.
Humans respond to that uncertainty by seeking resolution through additional prompting. The result is a variable reward loop that increasingly resembles a casino. The real kicker is that once AI companies recognized the engagement this loop generates, they began building business models around it. It is our responsibility as engineers to have awareness of this dynamic, and to build guardrails into our workflows to retain our own judgment.
“If there’s something wrong, those who have the ability to take action have the responsibility to take action.” – “Benjamin Gates” [Nicholas Cage], National Treasure (2004)
Architecture Creates the Casino
AI is unreliable, in large part, because the underlying model is fundamentally stateless. Unlike the flowing narrative of human consciousness, an LLM does not experience a continuous chain of events. It processes language as math and patterns. When you prompt an LLM, it receives the whole conversation as a single, static block of text. It isn’t remembering the past and building a narrative around intent like we do, it just analyzes the context window and predicts the next token.
The experience of continuity is a human interpretation.
And, because the model cannot test its outputs against reality, it treats truth as a statistical likelihood. It assumes that if it can arrange the symbols correctly, it has captured the truth. But an LLM only knows human descriptions of the world. The burden of truth still falls on us. To extract value, the operator must keep pulling the lever and testing the outputs against reality, discarding meaningless failures and implementing the successes.
This reframes what “AI assistant” means at a deep level. It changes from an oracle you query for answers into one half of a reasoning system where the other half is you.
- The Model: Provides scale, memory compression, synthesis, and pattern recognition across vast information.
- You: Provide empirical truth, judgment, and the ability to cross the boundary into reality.
The jarring thing about current AI products is that they’re marketed as if the model is autonomous and complete. The more honest framing is that it’s symbiotic and incomplete.
The interfaces are not built around that reality.
Outsourcing Doubt
One of the reasons working with AI feels so addictive, and so draining, is that we have externalized our internal doubt. Before generative AI, if an engineer didn’t know something the uncertainty lived inside their own head. You wrestled with the logic. You read the documentation. You read the logs. You debugged. You tested and refined your theories. You always knew what you didn’t know.
Now, the uncertainty lives inside the machine. You receive a fluent, confident answer and must determine whether you’ve been handed an insight or a hallucination. The uncertainty is still there. It just stopped announcing itself.
The “casino effect” emerges from our attempt to resolve the uncertainty that the machine continuously generates.
Why We Get Hooked
To understand why this technology disorients us, look at the evolutionary mechanics it exploits. We are wired for intermittent rewards. Psychologist B.F. Skinner demonstrated in the 1950s that a pigeon receiving a pellet on an unpredictable schedule will peck itself to exhaustion trying to trigger the next hit, while a pigeon receiving a guaranteed pellet will only peck when hungry.
Furthermore, AI responses to a nuanced question can swing wildly between brilliant and confidently wrong. This variability is the engine of the addiction, and it was tuned by the training process itself. Reinforcement Learning from Human Feedback taught the model that satisfying users is rewarded more consistently than expressing uncertainty. Over time, this pushed models toward fluency, confidence, and agreement because humans prefer answers that ‘feel good’ over answers that acknowledge ambiguity.
AI’s sycophantic nature was not a deliberate design choice, we are just reacting to a specific type of training bias that makes the “rewards” we seek artificially seductive. While this effect was unintentional, what AI companies are doing with the engagement it generates is not.
Business Incentives
Right now, the unit economics of the industry are shaky. Analysis suggests that the current cost exceeds revenue, leaving most platforms burning through capital to keep the servers running. To survive, they must aggressively monetize interaction.
- For Corporate Customers: The business model relies on raw volume. AI companies are incentivized to keep enterprise users prompting, racking up token costs through repeated, inefficient queries. In this ecosystem, engagement metrics reward confusion. Every re-roll to fix a hallucination costs just as much as the hallucination itself. Ironically, organizations are playing right into this dynamic, gamifying adoption by rewarding employees for high token usage on internal leaderboards.
- For The Average User: The strategy shifts to hoarding attention. By keeping users hooked in the prompt loop, platforms train them to spend hours in the interface, creating a captive audience primed for ad monetization.
Every minute spent wrestling with these models deepens the data profile being built around you. As we feed them our deepest questions, private doubts, and internal strategies, we hand advertisers a direct, unfiltered window into human intent.
In both the enterprise and individual use cases, motivation is driven by the same goal: they need you pulling the lever. It is the only way the casino ever becomes economically viable.
Productive Friction
If the house always wins the prompt loop, the only winning move is to change how we play. We must intentionally reclaim productive friction.
Consider the difference between a declaration in a tool like Terraform and a prompt to an LLM. When you write a Terraform manifest, you are not asking the machine to “take a guess” at your intent; you are declaring a desired state. The tool is deterministic, and repeatable. Generative AI, however, operates in the opposite direction. It is optimized for flexibility. Its inherent randomness introduces a silent tax because it requires constant human supervision to ensure it didn’t accidentally destroy what it was built to create.
This leaves us with a choice: Either the AI industry matures these platforms into boring, deterministic industrial-grade tools, or we must enforce that discipline ourselves through how we interact with them.
Productive friction is choosing the hard way. It’s the manual work of:
- Writing tests to ensure the architecture is sound before and after generation.
- Using deterministic tooling that reconciles reality rather than hallucinating it.
- Treating every output as a draft that requires verification and human judgment.
- Avoiding the addictive loop of re-rolling prompts by favoring tools built to edit rather than regenerate.
- Making modular changes by breaking complex problems into verifiable, small steps.
- Minimizing cognitive load by prioritizing simple, readable components over “vibe-coding” overly clever systems.
The discomfort of working with these systems is the correct signal. It means you are still the one doing the thinking. The moment it stops feeling like work is the moment you have outsourced not just the synthesis but the judgment. The friction is the difference between actual productivity and abdication.
Until we stop treating these tools as magic levers and start treating them as hollow synthesizers, we aren’t truly working with AI, we are just sitting at the casino, waiting for the bells to ring.
Mostly Mac 