GHOST on Nostr: Well holy crap I had to go round and round but finally got a python script that will ...
Well holy crap I had to go round and round but finally got a python script that will fine tune a 3B AI model with only 6G of VRAM. 5 epochs in about 12 minutes. If anyone wants the script I can post it.
Published at
2025-02-16 23:06:45Event JSON
{
"id": "988ecc4f8fba3ed979531df46337e1a029d25ca12a3c7df7a01b2f0129edf1cf",
"pubkey": "3b7fc823611f1aeaea63ee3bf69b25b8aa16ec6e81d1afc39026808fe194354f",
"created_at": 1739747205,
"kind": 1,
"tags": [],
"content": "Well holy crap I had to go round and round but finally got a python script that will fine tune a 3B AI model with only 6G of VRAM. 5 epochs in about 12 minutes. If anyone wants the script I can post it. ",
"sig": "7524cb577e681e1e941bd90299b961d0e8abdf6ddca7df680ec1a2e0932c6a510615f5ff3bd7eea52013affd37011b520d4351a20dc2203e94f1eedbd19bfcce"
}
