Erik Jonker on Nostr: DisTrO sounds exciting, A new way to train large AI models that drastically reduces ...
DisTrO sounds exciting,
A new way to train large AI models that drastically reduces the need for super-fast internet connection, potentially allowing training on regular home computers and internet connections. The promise is that DisTrO cuts down the amount of data that needs to be shared between computers during pre-training and during fine-tuning with several magnitudes.
But only a preliminary report , not a reviewed paper yet.
https://github.com/NousResearch/DisTrO
#AI #training #distributed #DisTrO
A new way to train large AI models that drastically reduces the need for super-fast internet connection, potentially allowing training on regular home computers and internet connections. The promise is that DisTrO cuts down the amount of data that needs to be shared between computers during pre-training and during fine-tuning with several magnitudes.
But only a preliminary report , not a reviewed paper yet.
https://github.com/NousResearch/DisTrO
#AI #training #distributed #DisTrO