ChipTuner on Nostr: I've been running the 12b model myself and WOW is all I can say. I've been on it ...
I've been running the 12b model myself and WOW is all I can say. I've been on it nearly every day and it's been still surprising me. I'm running very old hardware, and just letting CPU's cook away in my current cluster. I'm finally trying to put together a dedicated machine with some GPU this week. I'm going to try to get a cheap tesla 24g card on order soon after I get some things tested.
Published at
2025-04-21 15:23:27Event JSON
{
"id": "729ea4d386b4f642dae432b080709491c66090c42f846f9eddb53aef7bfc21f4",
"pubkey": "036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58",
"created_at": 1745249007,
"kind": 1,
"tags": [
[
"e",
"4246a3ea03a8b516fe06559d5ff5929fa1d994060080f2190bc4e0acef3b4d51",
"",
"root"
],
[
"e",
"f0f609adf851a0be068b8f4bf6d1af1fc4e3ad92dcc92a3ee0b5762cd1e41de2",
"nostr-idb://cache-relay",
"reply",
"40b9c85fffeafc1cadf8c30a4e5c88660ff6e4971a0dc723d5ab674b5e61b451"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"40b9c85fffeafc1cadf8c30a4e5c88660ff6e4971a0dc723d5ab674b5e61b451"
]
],
"content": "I've been running the 12b model myself and WOW is all I can say. I've been on it nearly every day and it's been still surprising me. I'm running very old hardware, and just letting CPU's cook away in my current cluster. I'm finally trying to put together a dedicated machine with some GPU this week. I'm going to try to get a cheap tesla 24g card on order soon after I get some things tested. ",
"sig": "c630cc933f89502a11bbc6b0d6b99d97d37e86ccbf54bd45d035c1fef7ca324d6e8cddeb3bdd8c8011d42a1df799fda34fceb339df31702002463af851c470b4"
}
