decentony on Nostr: They literally banned the following mathematics: Attention(Q, K, V) = softmax(QK^T / ...
They literally banned the following mathematics:
Attention(Q, K, V) = softmax(QK^T / sqrt(d_k))V
🤣
Italians look away please, you are not supposed to see this formula.
Published at
2023-03-31 16:12:35Event JSON
{
"id": "c679c34240466b9bcee1986179d67156a22d7dde6b7c16807cfd7f2d254a4a93",
"pubkey": "084b886cb4d572e164714ea2a3d7636978a1421b1e41551aa35ae2578b761c95",
"created_at": 1680279155,
"kind": 1,
"tags": [
[
"e",
"8f2913303a06226d020be588ac830df3a864a491cf1b94a8f0a892e5919d1eaf"
],
[
"e",
"f96bc322a5ee6f5a58beb28ab53c30040691cfeb6011b6116733bce4094b6983"
],
[
"e",
"d297123821c3e3820bf1ef965ff92fb12a24cf7f01efb04276042151c306f0a2"
],
[
"p",
"084b886cb4d572e164714ea2a3d7636978a1421b1e41551aa35ae2578b761c95"
],
[
"p",
"a8171781fd9e90ede3ea44ddca5d3abf828fe8eedeb0f3abb0dd3e563562e1fc"
],
[
"p",
"6ed65feee1baee7cf57dca1d30b485599cda231c95f828c0c94559b39af599d7"
]
],
"content": "They literally banned the following mathematics:\n\nAttention(Q, K, V) = softmax(QK^T / sqrt(d_k))V\n\n🤣\n\nItalians look away please, you are not supposed to see this formula.",
"sig": "df66b886260c0691d7248d57498871a0de43a71a7b9918fcb0e6207a27ca592c3695be7244c105455492b617bb697c611d28d2646bd2d1cd6e83537525623e7f"
}