Dr. jonny phd on Nostr: The way it is complimenting the prompter throughout for their fascinating and ...

The way it is complimenting the prompter throughout for their fascinating and groundbreaking theorizing is giving me a very grim pit in my stomach. Normal conspiracy theories are sticky and trap people's minds, but their cultures are actually usually highly internally critical and collaborative - it might seem ironic but in conspiracy theory forums you get intense exclusion of "the wrong version" of the theory, both as a way to maintain some vanishing sense of "external credibility" but also as a group norming and hierarchy mechanism.

I think almost everyone knows that LLMs will enthusiastically tell you the wrong information, but I hadn't seen an example of an LLM enthusiastically telling you are a genius as you slip away from reality. There is no way to set guardrails against that. There is no macro pattern and there is nothing intrinsically harmful about the content per se, the harm is how its use will alienate, isolate, and likely cause a great deal of personal crisis in this person's life - and they won't be able to tell it was chatGPT that helped them get there.