What is Nostr?
decentony / Decentony⚡
npub1pp9…fzpm
2023-03-31 16:12:35
in reply to nevent1q…6ng8

decentony on Nostr: They literally banned the following mathematics: Attention(Q, K, V) = softmax(QK^T / ...

They literally banned the following mathematics:

Attention(Q, K, V) = softmax(QK^T / sqrt(d_k))V

🤣

Italians look away please, you are not supposed to see this formula.
Author Public Key
npub1pp9csm9564ewzer3f63284mrd9u2zssmreq42x4rtt390zmkrj2st4fzpm