Tom Morris on Nostr: I started testing a popular LLM with multiple choice questions used in a professional ...
I started testing a popular LLM with multiple choice questions used in a professional qualification exam.
So far it's doing only a tiny smidgen better than chance alone, and way below the pass rate.
Anyone who tells you that a chatbot is gonna replace your doctor, lawyer, teacher or whatever any time soon is selling you an absolute load of baloney. None of this takes away from how good these systems are at at writing marketing copy and LinkedIn thought leader BS.
So far it's doing only a tiny smidgen better than chance alone, and way below the pass rate.
Anyone who tells you that a chatbot is gonna replace your doctor, lawyer, teacher or whatever any time soon is selling you an absolute load of baloney. None of this takes away from how good these systems are at at writing marketing copy and LinkedIn thought leader BS.