sj_zero on Nostr: New experiment with self-hosted AI today. I had a machine with a much newer processor ...
New experiment with self-hosted AI today. I had a machine with a much newer processor but much less ram, 8GB instead of 16GB and 7th gen i5 vs 4th gen. It completely turned the results on their head, total failure. Pegged all cores for minutes and never did come out with an answer, which suggests to me that memory is much more important than cpu as a base thing
Published at
2023-12-31 06:35:08Event JSON
{
"id": "7a847d7a11e961cca73f8a3b4b8620af0bc866f7672f461a9547c729183511b6",
"pubkey": "dc6b1739cddb3a3cd6356f41590644c54159b29a0a568bbe32cca9faaba2856a",
"created_at": 1704004508,
"kind": 1,
"tags": [
[
"proxy",
"https://social.fbxl.net/objects/3aab75cf-11cb-4964-a5bb-2259a153be4d",
"activitypub"
]
],
"content": "New experiment with self-hosted AI today. I had a machine with a much newer processor but much less ram, 8GB instead of 16GB and 7th gen i5 vs 4th gen. It completely turned the results on their head, total failure. Pegged all cores for minutes and never did come out with an answer, which suggests to me that memory is much more important than cpu as a base thing",
"sig": "9de8a4cb03632579b2a82dc72707e9471201b3792cfcddb21ba452537faa9b0a16ac93b884020864b828d7486f08cf7dcf5953d72ec6cfc366a67b6a6feec93e"
}
