Leftist Lawyer on Nostr: Quelle surprise! The ChatGPT folks lied about the bar exam performance. From the ...
Quelle surprise!
The ChatGPT folks lied about the bar exam performance.
From the abstract:
"Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to 48th percentile overall, and 15th percentile on essays.
_________________________________
In other words, it failed spectacularly. Most states you have to be in 64th percentile to pass.
And the essays? Those are the money ... that's where everyone trips up on the bar exam ... the essays. 15%.
Fucking. Frauds.
#AI #TechBroGrift
https://link.springer.com/article/10.1007/s10506-024-09396-9
The ChatGPT folks lied about the bar exam performance.
From the abstract:
"Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to 48th percentile overall, and 15th percentile on essays.
_________________________________
In other words, it failed spectacularly. Most states you have to be in 64th percentile to pass.
And the essays? Those are the money ... that's where everyone trips up on the bar exam ... the essays. 15%.
Fucking. Frauds.
#AI #TechBroGrift
https://link.springer.com/article/10.1007/s10506-024-09396-9