Lauren Weinstein on Nostr: Here's a vivid example of how badly #Google Search AI Overviews can screw up a simple ...
Here's a vivid example of how badly #Google Search AI Overviews can screw up a simple question. I ask it twice, with almost identical wording, whether Vasquez Rocks is in the TMZ -- the Hollywood Thirty Mile Zone. In one case it definitively says yes. In the other, it just as definitively says no! Note that after saying No in the main answer, the added text below contradicts that. It can't even get its answer straight in a single response!
And this is a harmless question. What happens when someone asks about something really important and this happens? AI Overviews are worse than useless because you CANNOT TRUST THE ANSWERS! All the Google disclaimers in the galaxy won't fix that.
Published at
2024-10-22 15:04:17Event JSON
{
"id": "5e632618b085f57a3b31a66feef28318b93527e547681caca66d880147080855",
"pubkey": "a447aea32251d6c533dc9cbbf15d3e41529f8a6719c99cee944bfd9aa0928ef0",
"created_at": 1729609457,
"kind": 1,
"tags": [
[
"t",
"google"
],
[
"proxy",
"https://mastodon.laurenweinstein.org/users/lauren/statuses/113351685382748787",
"activitypub"
]
],
"content": "Here's a vivid example of how badly #Google Search AI Overviews can screw up a simple question. I ask it twice, with almost identical wording, whether Vasquez Rocks is in the TMZ -- the Hollywood Thirty Mile Zone. In one case it definitively says yes. In the other, it just as definitively says no! Note that after saying No in the main answer, the added text below contradicts that. It can't even get its answer straight in a single response!\n\nAnd this is a harmless question. What happens when someone asks about something really important and this happens? AI Overviews are worse than useless because you CANNOT TRUST THE ANSWERS! All the Google disclaimers in the galaxy won't fix that.\n\nhttps://mastodon.laurenweinstein.org/system/media_attachments/files/113/351/681/414/257/270/original/8a93b698d41cd6b8.png\n\nhttps://mastodon.laurenweinstein.org/system/media_attachments/files/113/351/681/414/686/717/original/553c3a4cb68aa3e6.png",
"sig": "147d94d292a0f754e2a62f80e0f9c23088892ff2c5c8be685ca61af44723756192d14f2360f2d4d48489f0bd3310a528c19d76e8e32737844345c2af25c1a174"
}