Scott Jenson on Nostr: To the surprise of only the Tech Bros, "scraping and training" isn't an infinite ...

To the surprise of only the Tech Bros, "scraping and training" isn't an infinite slope of improvement, it's a diminishing slope of returns. Things are 'just going to get magically better'.

But to be clear, this also doesn't mean #LLMs are doomed either. This is just a bump in the road (that was predicted by people much smarter than me many months ago)
https://www.reuters.com/technology/artificial-intelligence/openai-rivals-seek-new-path-smarter-ai-current-methods-hit-limitations-2024-11-11/