Greg Wilson on Nostr: Gundersen et al 2024: "The Unreasonable Effectiveness of Open Science in AI: A ...
Gundersen et al 2024: "The Unreasonable Effectiveness of Open Science in AI: A Replication Study"
https://arxiv.org/abs/2412.17859 "We performed a systematic replication study including 30 highly cited AI studies relying on original materials when available. The availability of code and data correlate strongly with reproducibility… Surprisingly, [w]hether the code is poorly documented, partially missing, or not versioned is not important for successful replication, as long as the code is shared." #nwit
Published at
2024-12-28 11:14:20Event JSON
{
"id": "93054eefd9fa175e4eaf321e589593105be0430c43671eedeb7a454b8dbd19e9",
"pubkey": "471ec8585d6c2fd5f911c7a8444add9942c4b8e37365db2a1cb87c5e13c0df8f",
"created_at": 1735384460,
"kind": 1,
"tags": [
[
"t",
"nwit"
],
[
"proxy",
"https://mastodon.social/users/gvwilson/statuses/113730155970681732",
"activitypub"
]
],
"content": "Gundersen et al 2024: \"The Unreasonable Effectiveness of Open Science in AI: A Replication Study\" https://arxiv.org/abs/2412.17859 \"We performed a systematic replication study including 30 highly cited AI studies relying on original materials when available. The availability of code and data correlate strongly with reproducibility… Surprisingly, [w]hether the code is poorly documented, partially missing, or not versioned is not important for successful replication, as long as the code is shared.\" #nwit",
"sig": "be03edd7951dcb5db9fc189b30b0aea2699a49bff13ac42b82323f8bc375f4755926f7b184356b78b18af2875b840044c4fc5d33b71b76fa73714cf83b502c1d"
}
