Jeroen Baert on Nostr: As expected, throwing more data and compute at the problem is not viable any more. - ...
As expected, throwing more data and compute at the problem is not viable any more.
- Running out of data (and synthetic data isn't good enough)
- Exponential compute costs for sub-linear improvement. Fine if you've got cash to burn, but that doesn't last.
https://www.wsj.com/tech/ai/openai-gpt5-orion-delays-639e7693?st=ng5hBi&reflink=desktopwebshare_permalink
- Running out of data (and synthetic data isn't good enough)
- Exponential compute costs for sub-linear improvement. Fine if you've got cash to burn, but that doesn't last.
https://www.wsj.com/tech/ai/openai-gpt5-orion-delays-639e7693?st=ng5hBi&reflink=desktopwebshare_permalink