Bartosz Milewski on Nostr: Why am I skeptical about AI reaching superhuman intelligence? I think there is a ...
Why am I skeptical about AI reaching superhuman intelligence? I think there is a natural barrier to increasing intelligence. The more complex the neural system, the most likely it is to start hallucinating. Natural selection led humans to the very threshold of what's possible. It had to stop because further progress led to insanity. This is why human intelligence spans such a narrow spectrum. The gap between an idiot and a genius is not that big. And as the society reaches a certain level, it too starts hallucinating, falling for nonsensical conspiracy theories and becoming self-destructive. Literally reaching the MAD level.
Published at
2025-02-14 11:08:39Event JSON
{
"id": "490ced69a1d95b4d3c8a21f4c8d221c2c92b2298de49f34841d8b6679a274273",
"pubkey": "a60a88374d8e1cf092c7ea93662aa784fb33b3e75be7725017032e6929ebc5d5",
"created_at": 1739531319,
"kind": 1,
"tags": [
[
"proxy",
"https://mathstodon.xyz/users/BartoszMilewski/statuses/114001924563130223",
"activitypub"
]
],
"content": "Why am I skeptical about AI reaching superhuman intelligence? I think there is a natural barrier to increasing intelligence. The more complex the neural system, the most likely it is to start hallucinating. Natural selection led humans to the very threshold of what's possible. It had to stop because further progress led to insanity. This is why human intelligence spans such a narrow spectrum. The gap between an idiot and a genius is not that big. And as the society reaches a certain level, it too starts hallucinating, falling for nonsensical conspiracy theories and becoming self-destructive. Literally reaching the MAD level.",
"sig": "78a0cbfdd9d59842381dffc107b6df6ab492d7312f2b356d8b16699c338c94b926789debbf049b250c5b4a33a6f24c3edc2d663e89acaecf007614cf9b03cf72"
}