Low Information Voter on Nostr: It contains maths, which repells journalists. And criticising it could cost owners ...
It contains maths, which repells journalists. And criticising it could cost owners the opportunity to use it as an excuses to cut wages and headcount. That's why its not talked about.
Its not as bad as the headline number suggest. Training (building new LLMs and other types of models) consumes many orders of magnitude more energy than inference (using AIs to do stuff). As the technology matures, it will become less about building "the new hotness" and more about integrating it into workflows at lowest cost, and keeping old models running on newer hardware.
Its not as bad as the headline number suggest. Training (building new LLMs and other types of models) consumes many orders of magnitude more energy than inference (using AIs to do stuff). As the technology matures, it will become less about building "the new hotness" and more about integrating it into workflows at lowest cost, and keeping old models running on newer hardware.