What is Nostr?
Glyph /
npub1h5u…y2g4
2025-03-08 01:42:14
in reply to nevent1q…w24e

Glyph on Nostr: nprofile1q…gr95k I have seen nprofile1q…8ssyg make the claim that local / PC LLM ...

nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqsez452jmmfk5nq34qaqxnrvrf5rzwkjpedw3w7y389hl6qwm45mqtgr95k (nprofile…r95k) I have seen nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqf6a33pfyp67y8llhunlhrf855xm47n3fdqymvxfj7yx78c6vqf4sy8ssyg (nprofile…ssyg) make the claim that local / PC LLM use is actually *less* power (and thus carbon) efficient than datacenter usage, and I absolutely cannot square this with the moral panic pieces telling us that every word that ChatGPT produces ends up befouling ten liters of water or whatever. I don't know how this math works; are the journalists just totally wrong and misunderstanding the mechanics? Is simon mistaken? Is training getting amortized into generating somehow?
Author Public Key
npub1h5u94g9409m9c6yrckcwk9lg4c6sexyvvk23p0s7s3f42lhrs7zq75y2g4