imp0stor on Nostr: I wonder if you can plug it into llama on umbrel or Start9 on a system with some GPUs ...
I wonder if you can plug it into llama on
umbrel (npub1agh…mhct) or
Start9 (npub126n…e9ll) on a system with some GPUs and use it to train data. I have not looked at the llama or the implementation of it on these systems, but if it is based on llama and faster, I bet there is a good use case for optionally running it. Do these installs allow training or are they just running models?
Published at
2024-10-19 22:06:08Event JSON
{
"id": "5d0337882bb623352f1191e847c7421bd6e5afa5f375ceb031dc78f7cbadc0fc",
"pubkey": "e26961c1bd74f4b3801ac1797802885dac797c43ef2b0c950c2ed36112a91f89",
"created_at": 1729375568,
"kind": 1,
"tags": [
[
"e",
"aca5307a5849035e4750d0fd1ba7c809cd91f4b4f0195a84c0499791a5b4420c",
"",
"root"
],
[
"p",
"de7ecd1e2976a6adb2ffa5f4db81a7d812c8bb6698aa00dcf1e76adb55efd645"
],
[
"p",
"ea2e3c814d08a378f8a5b8faecb2884d05855975c5ca4b5c25e2d6f936286f14"
],
[
"p",
"56a6b75373c8f7b93c53bcae86d8ffbaba9f2a1b38122054fcdb7f3bf645b727"
]
],
"content": "I wonder if you can plug it into llama on nostr:npub1aghreq2dpz3h3799hrawev5gf5zc2kt4ch9ykhp9utt0jd3gdu2qtlmhct or nostr:npub126ntw5mnermmj0znhjhgdk8lh2af72sm8qfzq48umdlnhaj9kuns3le9ll on a system with some GPUs and use it to train data. I have not looked at the llama or the implementation of it on these systems, but if it is based on llama and faster, I bet there is a good use case for optionally running it. Do these installs allow training or are they just running models?",
"sig": "249689ee613268767a65dd14ad03bba84607bbde3f3b295f519a4f6858beeda8085a5811a6d30331ff5ee0e037620f683e3c3fdd0ee579c75698ae8c46f7438c"
}