zemanovix on Nostr: Hello , what would you recomend as a starting HW for running localy LLM ( that would ...
Hello , what would you recomend as a starting HW for running localy LLM ( that would be at least powerful as ChatGPT-01 mini ) . I only saw a clusters of Mac mini m4 which is a lot of money . Are we even in the era of available hw for llm or should I wait ? Thanks
Published at
2025-01-30 07:18:26Event JSON
{
"id": "7fab13b68c1a0f0e79777a92ca440f3ced7629f22147dc0e472a0d318af0bbed",
"pubkey": "8aa7804ec882c9ce0ba2cbb0f930f5a83fc88f809d8d9364f3eab1fe83549d45",
"created_at": 1738221506,
"kind": 1,
"tags": [
[
"e",
"fd34639b455a6fc3240b477242cd114c3dcfeb99cfa7695b683931739138259a",
"",
"root"
],
[
"p",
"dab6c6065c439b9bafb0b0f1ff5a0c68273bce5c1959a4158ad6a70851f507b6"
]
],
"content": "Hello , what would you recomend as a starting HW for running localy LLM ( that would be at least powerful as ChatGPT-01 mini ) . I only saw a clusters of Mac mini m4 which is a lot of money . Are we even in the era of available hw for llm or should I wait ? Thanks",
"sig": "f953b3922b23572c82f882364222d6445cd71d21a6bf5e0a9c60e3ca9d28a57c9d96ae9ed271177a62ee691a3a238e30ff12ae24b6468d709fe6a9a3b413db61"
}
