:mastodon: Mike Amundsen on Nostr: ChatGPT's odds of getting code questions correct are worse than a coin flip ...
ChatGPT's odds of getting code questions correct are worse than a coin flip
https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/
"'Our analysis shows that 52 percent of ChatGPT answers are incorrect and 77 percent are verbose,' the team's paper concluded. 'Nonetheless, ChatGPT answers are still preferred 39.34 percent of the time due to their comprehensiveness and well-articulated language style.' Among the set of preferred ChatGPT answers, 77 percent were wrong." -- #ThomasClaburn
#api360 #chatGPT #programming
https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/
"'Our analysis shows that 52 percent of ChatGPT answers are incorrect and 77 percent are verbose,' the team's paper concluded. 'Nonetheless, ChatGPT answers are still preferred 39.34 percent of the time due to their comprehensiveness and well-articulated language style.' Among the set of preferred ChatGPT answers, 77 percent were wrong." -- #ThomasClaburn
#api360 #chatGPT #programming