Nassim Nicholas Taleb / @nntaleb (RSS Feed) on Nostr: LLM are unable to stop making things up, based on what \*would\* make sense. This is ...

LLM are unable to stop making things up, based on what \*would\* make sense. This is STRUCTURAL owing to the probabilistic construction.

ChatGPT kept confabulating around an obscure short story by G. Greene, because there was not enough information on the web & it is taking a max likeliood approach.

ChatGPT actually proves that G. Greene is a great novelist because he is not a recombination of what would make sense.





https://nitter.moomoo.me/nntaleb/status/1665636010472923136#m