petersuber on Nostr: How bad are #AI tools at citing real research? ...
How bad are #AI tools at citing real research?
https://www.thieme-connect.de/products/ejournals/abstract/10.1055/s-0044-1786033
In April 2023 researchers created a competition in which they asked #ChatGPT, Google #Bard [now #Gemini], and #Chatsonic to cite "specific obstetrical randomized controlled trials (RCTs) published in 2020."
Bard ran away with it, but only cited 13.6% of the RCTs. ChatGPT scored 2.4%, and Chatsonic 0%.
https://www.thieme-connect.de/products/ejournals/abstract/10.1055/s-0044-1786033
In April 2023 researchers created a competition in which they asked #ChatGPT, Google #Bard [now #Gemini], and #Chatsonic to cite "specific obstetrical randomized controlled trials (RCTs) published in 2020."
Bard ran away with it, but only cited 13.6% of the RCTs. ChatGPT scored 2.4%, and Chatsonic 0%.