Laurens Hof on Nostr: this seems relevant. one major factor in the current AI hypecycle is the supposed ...
this seems relevant. one major factor in the current AI hypecycle is the supposed rapid speed of improvements of models. Turns out that GPT4 is just GPT3, but stacked 8 versions of itself on top of each other. Sure, thats a nice idea and improves performance, so smart idea. But at the same time invalidates this idea of super fast exponential growth where models get orders of magnitudes powerful with each release.
https://thealgorithmicbridge.substack.com/p/gpt-4s-secret-has-been-revealed 
Published at
2023-06-25 10:52:02Event JSON
{
"id": "2387b81a8fbdf855963896706c7d9deaa34db38c18637c804f7859b7417ae16c",
"pubkey": "b8947a059dfc389b566a395add8dea5251f10d39284dd56181e27e61896604c0",
"created_at": 1687690322,
"kind": 1,
"tags": [
[
"mostr",
"https://calckey.social/notes/9gevk07vyro93s42"
]
],
"content": "this seems relevant. one major factor in the current AI hypecycle is the supposed rapid speed of improvements of models. Turns out that GPT4 is just GPT3, but stacked 8 versions of itself on top of each other. Sure, thats a nice idea and improves performance, so smart idea. But at the same time invalidates this idea of super fast exponential growth where models get orders of magnitudes powerful with each release.\n\nhttps://thealgorithmicbridge.substack.com/p/gpt-4s-secret-has-been-revealed\n\nhttps://bunnyt1c.s3.us-east-005.backblazeb2.com/calckeysoc/f42113ce-16dc-4ea5-bff6-636ed44736a4.png",
"sig": "1756dd3b124d431692774e42e0a1a47b9110f55588fad72a6f025963c4ec4ba3b276e125d2292a6b90dc3300ed72d9987ec2b59b32885a253cd3d419f4037b5e"
}