Krazy Kitty on Nostr: It's buried in a followers-only conversation I had in French, but from what I've been ...
It's buried in a followers-only conversation I had in French, but from what I've been reading, a chat of about 25 queries with an LLM consumes half a liter of water (in cooling) [1] and produces as much CO2eq as a 200km car drive [2]. That's enormous?
[1] https://arxiv.org/abs/2304.03271
[2] https://arxiv.org/abs/2211.02001 – 19 kg CO2eq per day, 558 requests per hour, about 800g CO2eq per request, 1km by thermal car is about 100g CO2eq as per https://www.openco2.net/en/co2-converter
[1] https://arxiv.org/abs/2304.03271
[2] https://arxiv.org/abs/2211.02001 – 19 kg CO2eq per day, 558 requests per hour, about 800g CO2eq per request, 1km by thermal car is about 100g CO2eq as per https://www.openco2.net/en/co2-converter