Karthik Srinivasan on Nostr: npub1kq0nf…x8hsx hahaha... nice one. "Matrix multiplication" in the brain itself ...
npub1kq0nfpugx8czz3u8d2wljxephk0zmn8p2y00vqhprsw8rfn7sucsvx8hsx (npub1kq0…8hsx)
hahaha... nice one.
"Matrix multiplication" in the brain itself seems quite low, it is even worse. Softmax(QK)V: multiply, simplex it, then multiply, but do that all simultaneously.
hahaha... nice one.
"Matrix multiplication" in the brain itself seems quite low, it is even worse. Softmax(QK)V: multiply, simplex it, then multiply, but do that all simultaneously.