hermeticvm on Nostr: What's your quality requirement? Complicated code assist, minor rephrasing, idea ...
What's your quality requirement? Complicated code assist, minor rephrasing, idea generation? Depending on your hardware maybe try ollama with a properly sized model that your GPU can hold.
If you want to test it I can give you an account on my OpenWebUI with a couple of models available. Tops at 14B don't expect top tier results.
Published at
2025-01-19 00:13:04Event JSON
{
"id": "3a19a4b4d12bc9704f41321fad27fc3d98a3055299842c786e71bda9b0f75295",
"pubkey": "1a5cff5118d071a2c5d46534733abb9f3dcdfc41b24db0132fc20dbf01c75f78",
"created_at": 1737245584,
"kind": 1,
"tags": [
[
"p",
"ce3ac922587496661786cce66b9c9983ec820e1c6d644dc8f416c7c4afb77f17",
""
],
[
"e",
"557219f6552efb4424c56c37458ec122df013832d0e34c5e85356d673a87bb05",
"wss://relay.wellorder.net",
"root",
"ce3ac922587496661786cce66b9c9983ec820e1c6d644dc8f416c7c4afb77f17"
]
],
"content": "What's your quality requirement? Complicated code assist, minor rephrasing, idea generation? Depending on your hardware maybe try ollama with a properly sized model that your GPU can hold.\n\nIf you want to test it I can give you an account on my OpenWebUI with a couple of models available. Tops at 14B don't expect top tier results. ",
"sig": "d0acd49e442748f17a09e81dc44e2a86666eef9cc23eca6af6ba9634305419cb640cabd080122fecbc34d42af65c8dc756de798641180c860613b06dd8bd2b49"
}
