z_cress on Nostr: This is really interesting. #education ...
This is really interesting. #education
quoting note1cxx…r8axOpen AI Has Kept Secret an Accurate ChatGPT Detector for Two Years
According to The Wall Street Journal, “OpenAI has a method to reliably detect when someone uses ChatGPT to write an essay or research paper” but hasn’t released it yet, despite concerns about widespread student cheating on assignments with it, as well as other illicit uses. – The WSJ writes: The project has been mired in internal debate at OpenAI for roughly two years and has been ready to be released for about a year, according to people familiar with the matter and internal documents viewed by The Wall Street Journal. “It’s just a matter of pressing a button,” one of the people said. Why the delay? In trying to decide what to do, OpenAI employees have wavered between the startup’s stated commitment to transparency and their desire to attract and retain users. The detection technology is a watermark system that is reportedly 99.9% effective. Here’s how it works: ChatGPT is powered by an AI system that predicts what word or word fragment, known as a token, should come next in a sentence. The anticheating tool under discussion at OpenAI would slightly change how the tokens are selected. Those changes would leave a pattern called a watermark. The watermarks would be unnoticeable to the human eye but could be found with OpenAI’s detection technology. The detector provides a score of how likely the entire document or a portion of it was written by ChatGPT. The watermarks are 99.9% effective when enough new text is created by ChatGPT, according to the internal documents. Apparently a version of the watermarking technology has been developed by Google that can detect text generated by its LLM, Gemini AI (the detection technology “is in beta testing and isn’t widely available”). The detection technology does not appear to negatively affect the quality of the text generated by LLMs (which was one concern voiced by opponents of releasing the technology). OpenAI’s own survey data shows that people would prefer the technology to be released by a margin of four to one. What has kept it under wraps, it seems, are worries about how it will affect OpenAI’s profitability: “nearly 30% [of surveyed ChatGPT users] said they would use ChatGPT less if it deployed watermarks and a rival didn’t.” Are there..
The post https://dailynous.com/2024/08/05/open-ai-has-kept-secret-an-accurate-chatgpt-detector-for-two-years/
.
https://dailynous.com/2024/08/05/open-ai-has-kept-secret-an-accurate-chatgpt-detector-for-two-years/