dontbelievethehype on Nostr: Don't believe the hype! ...
Don't believe the hype!
quoting nevent1q…3cxy📣NEW paper! Don’t believe the hype: bigger AI ≠ better AI. @SashaMTL, @GaelVaroquaux and me on how the race to bigger, and bigger AI has bad consequences and isn't necessary.
1. Smaller AI models often perform better than big models in context
And
2. obsession with bigness has severe collateral consequences, from climate costs, to concentrated power, to more surveillance, to the capture of AI research.
All of this, and what we can do instead 👇
arxiv.org/abs/2409.14160