GHOST on Nostr: Running various models locally on Ollama + Open WebUI. Some I sandbox and use RAG. ...
Running various models locally on Ollama + Open WebUI. Some I sandbox and use RAG.
Really digging the DeepSeek-R1-Distill-Llama-8B right now.
Published at
2025-02-07 23:11:15Event JSON
{
"id": "8cd39b82c5fa8c2ad29c32cd5611662c4b2c64b86a4c304200521388db77a832",
"pubkey": "3b7fc823611f1aeaea63ee3bf69b25b8aa16ec6e81d1afc39026808fe194354f",
"created_at": 1738969875,
"kind": 1,
"tags": [
[
"e",
"95489d09a1e820a717970a1dcc95a4f894ab8352c276fd10c988de01487e74c9",
"",
"root"
],
[
"e",
"8492ad087ad0ccbe1fc8be72ae4d3dc929700f7bede308de2134aae11d7f6bb5",
"",
"reply"
],
[
"p",
"df478568479de26b4a83c1bdc4dbab61b5cc82e1a312e2b28bc815a12a951e67"
],
[
"p",
"3b7fc823611f1aeaea63ee3bf69b25b8aa16ec6e81d1afc39026808fe194354f"
]
],
"content": "Running various models locally on Ollama + Open WebUI. Some I sandbox and use RAG. \n\nReally digging the DeepSeek-R1-Distill-Llama-8B right now. ",
"sig": "a8ceaa82aee53d70f61916d4e7f379af32da64e32a4c9545505b10b2e0f2d93746a578e34ab9cb541fb765f3ca3ede518400ca1ac4832661a37cbe9cb363cc7d"
}
