SUPERMAX on Nostr: I see this is for smaller models. Can I use this as well for ~100B parameter LLM's? ...
I see this is for smaller models. Can I use this as well for ~100B parameter LLM's?
Would prefer to do locally if I can; I do have access to hardware to do this
Published at
2025-01-14 02:45:19Event JSON
{
"id": "a783abe271c94af6191ecf99efd4afdf3be10ded744079c482fda1fe77626ab4",
"pubkey": "ae1008d23930b776c18092f6eab41e4b09fcf3f03f3641b1b4e6ee3aa166d760",
"created_at": 1736822719,
"kind": 1,
"tags": [
[
"e",
"c5576144027c30d18afb06b872e2f60b78f427e9fc735f0ea09b7c4e1abf5133",
"",
"root"
],
[
"e",
"6c483fac27a8068744015fcfb72f2ad00a8899c450be4f166fcef67c8feee9ab"
],
[
"e",
"4b5b1324a59d9f39836b16bf4ec19cb41f62c3c3e2aa4bc76082b9ac6c879ab0",
"",
"reply"
],
[
"p",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1"
],
[
"p",
"ae1008d23930b776c18092f6eab41e4b09fcf3f03f3641b1b4e6ee3aa166d760"
],
[
"p",
"72783495e40cbf440889b04d6ed97c1bbc1d68164de210724075468bc1a69549"
]
],
"content": "I see this is for smaller models. Can I use this as well for ~100B parameter LLM's? \n\nWould prefer to do locally if I can; I do have access to hardware to do this ",
"sig": "231233ff561f4744e073967ba109e7e5c07aeb50154a813e6af90022ed12facca511a6a9b85ab3c10ec903d8c38564f102dc0c8251c92bc0e826995a67ccaa65"
}
