ChipTuner on Nostr: There are much smaller models and ones that are trained off R1 that need much less ...
There are much smaller models and ones that are trained off R1 that need much less hardware, but they seem to be big stinkers, so I was hoping others may have actually be able to do some real work with them without $6000 worth of hardware. I spend that much on far more hardware for my application, doesn't involve GPU's though and hard to justify the price of them for how many CPU's I could buy for the same price.
Published at
2025-02-15 03:15:16Event JSON
{
"id": "7af13e4ba036733ed213ea43a24a587ef9c0a9f6be8fe32143be58fcd44a2624",
"pubkey": "036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58",
"created_at": 1739589316,
"kind": 1,
"tags": [
[
"e",
"7d32e9eeb54e0bd8b9be78beaa9cdb826bd4ab30a176e680dbe4492be7a9e7e9",
"",
"root"
],
[
"e",
"f58634db64ad5604d14c3c3a0337d3918bcbe6c791e98ddf9a06003c003d94c1",
"nostr-idb://cache-relay",
"reply",
"60d8e6012ae385320a821c54b124b66a63095889ddb4d807128f02ce12b29bca"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"60d8e6012ae385320a821c54b124b66a63095889ddb4d807128f02ce12b29bca"
]
],
"content": "There are much smaller models and ones that are trained off R1 that need much less hardware, but they seem to be big stinkers, so I was hoping others may have actually be able to do some real work with them without $6000 worth of hardware. I spend that much on far more hardware for my application, doesn't involve GPU's though and hard to justify the price of them for how many CPU's I could buy for the same price. ",
"sig": "3dfa489d69e0cb92bb4a32e873f03fced59efc6b82e41bcda26ac695daa747adb50c03f8c84a847af9af376f8744d0a9367a46a9f17450cabe4bfc0413210562"
}
