Carl T. Bergstrom on Nostr: It is absolutely astounding to me that we are still earnestly entertaining the ...
It is absolutely astounding to me that we are still earnestly entertaining the possibility that #ChatGPT and #LLMS more broadly have a role in scientific writing, manuscript review, experimental design, etc.
The training data for the question below are massive. It's a very easy question if you're trained on the entire internet.
Question: What teams have never made it to the World Series?
Correct answer: Seattle Mariners.
Now, four responses from GPT4.
NB: The Nationals won it all in 2019.
Published at
2023-10-23 03:37:18Event JSON
{
"id": "dfcfa60a84d7d0e09f88f0246cfb9c7a94b60374625aaf168d933b3ae30496a1",
"pubkey": "ac5404833d7aff6cebf4afd632d367ccf064470e9ad728b47bce8be6bfbb958a",
"created_at": 1698032238,
"kind": 1,
"tags": [
[
"t",
"LLMs"
],
[
"t",
"chatgpt"
],
[
"proxy",
"https://fediscience.org/users/ct_bergstrom/statuses/111282240789145745",
"activitypub"
]
],
"content": "It is absolutely astounding to me that we are still earnestly entertaining the possibility that #ChatGPT and #LLMS more broadly have a role in scientific writing, manuscript review, experimental design, etc.\n\nThe training data for the question below are massive. It's a very easy question if you're trained on the entire internet.\n\nQuestion: What teams have never made it to the World Series?\n\nCorrect answer: Seattle Mariners.\n\nNow, four responses from GPT4.\n\nNB: The Nationals won it all in 2019.\n\nhttps://fediscience.org/system/media_attachments/files/111/282/215/376/439/416/original/94a97b5bfd2f9459.png\n\nhttps://fediscience.org/system/media_attachments/files/111/282/218/693/435/062/original/06fc753ca15223fc.png\n\nhttps://fediscience.org/system/media_attachments/files/111/282/227/513/231/479/original/1a418030eb706ca2.png\n\nhttps://fediscience.org/system/media_attachments/files/111/282/235/468/562/552/original/13f0651c12553b0b.png",
"sig": "3f6e60cf9bb5fd40b8370a8c8491aae5d73526ce74a9fd6ac2f39b518f9a1f0dfa85230348debb34c7f8cc2f1d137b4740e54e0e00aad13019055d0bea4b6184"
}