alphakamp on Nostr: I love the idea of running AI models locally, but it seems like ultimately, scale is ...
I love the idea of running AI models locally, but it seems like ultimately, scale is a huge issue, the larger the parameters/larger the model the more hardware you have to throw at it. At home, obviously you probably aren't gonna have more than one GPU. Certainly not 100s of thousands of gpus like the big boys have in their datacenters
Published at
2025-01-24 19:34:19Event JSON
{
"id": "39202e0e44f204c8ac57d7851094ff2d5b9f5a252c1eb264c17947c9bf1bbafc",
"pubkey": "cc53f373a72a82b7fb07d6efd6c8f07b32316e4ede4f9cfa908449554ff2ada5",
"created_at": 1737747259,
"kind": 1,
"tags": [],
"content": "I love the idea of running AI models locally, but it seems like ultimately, scale is a huge issue, the larger the parameters/larger the model the more hardware you have to throw at it. At home, obviously you probably aren't gonna have more than one GPU. Certainly not 100s of thousands of gpus like the big boys have in their datacenters",
"sig": "3bd500affe9d43e9ccb4768169be2f8135af465f2cda9a58d15fea5155adc96c7e0b4b7387a8553030da558b75073e767514e2a789a1d67a63360498dd6abadb"
}