Shiri Bailem on Nostr: Jesse Skinner :javascript: So true... bright spot on at least one front though: the ...
Jesse Skinner :javascript: (nprofile…m43n) So true... bright spot on at least one front though: the electricity usage is not an automatic necessity... that's from wasteful efforts to push it as fast as possible and to use unnecessary complex models.
There's already models popping up that clearly show a more reasonable future as far as resource consumption, prime case being the SmolLM2 set: huggingface.co/collections/Hug…
For reference, I have a 7 year old processor, no GPU, and 32GB of ram. The larger of the SmolLM2 models runs at a reasonable, if not snappy, speed while I'm doing other things.
They don't have to remain extreme power consuming systems running purely on the cloud, that's only limited to the extreme cutting edge where efficiency is the last thing they think about.
The rest on the other hand... that's capitalism as always. Problem goes away if we get rid of capitalism.
There's already models popping up that clearly show a more reasonable future as far as resource consumption, prime case being the SmolLM2 set: huggingface.co/collections/Hug…
For reference, I have a 7 year old processor, no GPU, and 32GB of ram. The larger of the SmolLM2 models runs at a reasonable, if not snappy, speed while I'm doing other things.
They don't have to remain extreme power consuming systems running purely on the cloud, that's only limited to the extreme cutting edge where efficiency is the last thing they think about.
The rest on the other hand... that's capitalism as always. Problem goes away if we get rid of capitalism.