Start9 on Nostr: Up to 30B parameter should fit just fine, though it will still be bottlenecked by ...
Up to 30B parameter should fit just fine, though it will still be bottlenecked by GPU, so only expect a few words per second.
Published at
2025-02-24 02:42:02Event JSON
{
"id": "a8f72e61dbf10ee645db014c473b02f9204b068dab97eb41066f2f0d9b8fcc64",
"pubkey": "56a6b75373c8f7b93c53bcae86d8ffbaba9f2a1b38122054fcdb7f3bf645b727",
"created_at": 1740364922,
"kind": 1,
"tags": [
[
"e",
"4d2c7106a98986ee9616174b7d76903516f8f5d46a2dccc9722018575c0d3c6c",
"",
"root"
],
[
"e",
"ad313c3f40268ffa39a6151051020d6441009efa019584230686096d4cae2c85",
"wss://nostr.bitcoiner.social/",
"reply",
"bdf02ee67066fdeba255e1ac77d67ad95048ded50eb885a01cab39156e4282df"
],
[
"p",
"56a6b75373c8f7b93c53bcae86d8ffbaba9f2a1b38122054fcdb7f3bf645b727"
],
[
"p",
"bdf02ee67066fdeba255e1ac77d67ad95048ded50eb885a01cab39156e4282df"
]
],
"content": "Up to 30B parameter should fit just fine, though it will still be bottlenecked by GPU, so only expect a few words per second.",
"sig": "090d1019d2508dc3c6d20eab2947bbf4862d601427925f04a3ce66e33003fb158ad41a793706c8c29426358faa096ec5409caefc21851789266d15aa0228cba4"
}