npub1yk…d2jl0 on Nostr: npub1l3gpk…qvu48 I've been reading up on how they work a lot, lately. I was ...
npub1l3gpk6vrudg8r67swqlex5alv9ch59s4lw46kk6hekuxe2n3aczsyqvu48 (npub1l3g…vu48) I've been reading up on how they work a lot, lately. I was extremely dismissive of them for a while, but I'm realizing that they're a _lot_ smarter than I gave them credit for - while still being far stupider than their proponents claim.
The way that GPT-2 turns english text into tokens is... uh. As a softwarer engineer, reading up on it, it feels like what a software engineer with a high-school understanding of English and a billion dollars of compute resources might do
Published at
2024-03-19 05:54:08Event JSON
{
"id": "0ea40e13d333612252c3eb9d328708da74b497208a20225ab9ed4ca3a47efead",
"pubkey": "25a9298ce9ed607f7539fb27d94418161476e7284b523577ce2e878fcf1852fd",
"created_at": 1710827648,
"kind": 1,
"tags": [
[
"p",
"fc501b6983e35071ebd0703f9353bf61717a1615fbabab5b57cdb86caa71ee05",
"wss://relay.mostr.pub"
],
[
"p",
"c95a71dfb95245bfb233a5ccea6dbcb03adda051221413144a54a206165aa52f",
"wss://relay.mostr.pub"
],
[
"e",
"1290b540ed925ffe031c7241c0b5ecc2f7ac336af27a58513fcaedd540f92029",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://merveilles.town/users/pixx/statuses/112120800791212310",
"activitypub"
]
],
"content": "nostr:npub1l3gpk6vrudg8r67swqlex5alv9ch59s4lw46kk6hekuxe2n3aczsyqvu48 I've been reading up on how they work a lot, lately. I was extremely dismissive of them for a while, but I'm realizing that they're a _lot_ smarter than I gave them credit for - while still being far stupider than their proponents claim.\n\nThe way that GPT-2 turns english text into tokens is... uh. As a softwarer engineer, reading up on it, it feels like what a software engineer with a high-school understanding of English and a billion dollars of compute resources might do",
"sig": "ca3b2e0ee5eff19a09368afbb89f4decc6ee36b2c6541145fa793f1e04deb8d8d957d7d6133cc90766aa36fee5ffeca604c5c64c6aded21b343d48ea82be8f92"
}
