Jon Udell on Nostr: Here's a test I'll be adding to my repertoire of LLM tests. "I left Singapore at 9PM ...
Here's a test I'll be adding to my repertoire of LLM tests.
"I left Singapore at 9PM on Oct 20, flying east to San Francisco where I will arrive at 9PM on Oct 20. How much daylight will I see looking out the window?"
All of them - ChatGPT4, Claude, Bard - got it spectacularly wrong, confidently asserting I'd see lots of daylight.
When I told them I'm 10 hours into the flight and have seen none so far they were all like "oh, yeah, right, sorry about that."
#llm
"I left Singapore at 9PM on Oct 20, flying east to San Francisco where I will arrive at 9PM on Oct 20. How much daylight will I see looking out the window?"
All of them - ChatGPT4, Claude, Bard - got it spectacularly wrong, confidently asserting I'd see lots of daylight.
When I told them I'm 10 hours into the flight and have seen none so far they were all like "oh, yeah, right, sorry about that."
#llm