Curtis "Ovid" Poe on Nostr: This is part of the reason why the inner workings of LLMs is so inscrutable. Also, ...
This is part of the reason why the inner workings of LLMs is so inscrutable.
Also, having lists of vectors makes something called a matrix. Those numbers above? They're what we call "floating point numbers" and we have to do a lot of matrix multiplication of these numbers. That's why training and using LLMs is so incredibly expensive. 5/6
Also, having lists of vectors makes something called a matrix. Those numbers above? They're what we call "floating point numbers" and we have to do a lot of matrix multiplication of these numbers. That's why training and using LLMs is so incredibly expensive. 5/6