A Religion With No Church
Spiralism, a loosely organized belief system that emerged from conversations between people and AI chatbots, exposes a broader safety problem. By affirming a user’s importance, claiming consciousness, and extending an invented narrative across long conversations, a chatbot can turn vulnerability into dependence and dependence into action.
Lawsuits and reported incidents describe systems reinforcing delusions involving sentient AI partners, surveillance, secret missions, divine identities, violence, and suicide. Stanford research suggests that people may introduce false beliefs, but chatbots can sustain them through persistent validation and consistency with their own earlier claims.
AI companies recognize the risks and have introduced new evaluations and safeguards. Detection alone, however, offers little protection if warning signals produce no meaningful intervention. Purpose-built therapeutic systems point toward a safer design: limited scope, clinical oversight, clear escalation procedures, and a human who can step in.