Nate on Nostr: I personally would prefer to have the LLM separate from Amethyst, but I've personally ...
I personally would prefer to have the LLM separate from Amethyst, but I've personally been real interested in trying to get some of the smaller models running on my phone inside or outside Amethyst. My phone is powerful enough to run some of the models no issue, though last I checked the existing software for mobile is a bit trickier than on PC, so I'd certainly welcome an easy way to get a GPU accelerated LLM running on my phone.
Published at
2025-03-07 01:27:45Event JSON
{
"id": "c63e58299c0ff8d2a225e6d89fb8b1dc08bfbdce85b2b83915d12ff95a8ff70b",
"pubkey": "910af9070dfd6beee63f0d4aaac354b5da164d6bb23c9c876cdf524c7204e66d",
"created_at": 1741310865,
"kind": 1,
"tags": [
[
"e",
"35db46db6f9000094cb95f2d0cfd5d53a1a14c916b0eabcdbf34caedf98eb4f8",
"wss://nostr.bitcoiner.social/",
"root",
"460c25e682fda7832b52d1f22d3d22b3176d972f60dcdc3212ed8c92ef85065c"
],
[
"e",
"35db46db6f9000094cb95f2d0cfd5d53a1a14c916b0eabcdbf34caedf98eb4f8",
"wss://nostr.bitcoiner.social/",
"reply",
"460c25e682fda7832b52d1f22d3d22b3176d972f60dcdc3212ed8c92ef85065c"
],
[
"p",
"460c25e682fda7832b52d1f22d3d22b3176d972f60dcdc3212ed8c92ef85065c"
]
],
"content": "I personally would prefer to have the LLM separate from Amethyst, but I've personally been real interested in trying to get some of the smaller models running on my phone inside or outside Amethyst. My phone is powerful enough to run some of the models no issue, though last I checked the existing software for mobile is a bit trickier than on PC, so I'd certainly welcome an easy way to get a GPU accelerated LLM running on my phone.",
"sig": "317aa50f401ed1ca5b47ef3ce13f0f0ce0f94ce2f11b8ddaca20b6e7a241601e856148d187502713ecbfb979fbea6455765f88f623720ae5a8683e542a6c4923"
}
