Rudy on Nostr: #AI #logic Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many ...
#AI #logic Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?
Here are 60 LLMs getting it wrong (via Vince Vatter @vatter.bsky.social)
https://benchmarks.llmonitor.com/sallyPublished at
2023-09-12 15:27:38Event JSON
{
"id": "c11b71f5d5a0f8755449a87c92f27933ee3c8b0d69491f936472ecb98671a092",
"pubkey": "e3b1aa478c32f25d82b2c5142f2eda70ada9d7ba5aef202f638e03233c164cb8",
"created_at": 1694532458,
"kind": 1,
"tags": [
[
"t",
"AI"
],
[
"t",
"logic"
],
[
"proxy",
"https://mstdn.ca/users/rudy/statuses/111052879185519000",
"activitypub"
]
],
"content": "#AI #logic Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have? \n\nHere are 60 LLMs getting it wrong (via Vince Vatter @vatter.bsky.social)\n\nhttps://benchmarks.llmonitor.com/sally",
"sig": "af46627403690070ccd1dd0658a617d04affa38f78e190aecdc7ce3ca60a9828ea040fee79f137a1ca93ebe9fffbd5a80727079f86960350a56989febff544f5"
}
