jb55 on Nostr: I just have ollama over wireguard, and I use litellm to interact with local or remote ...
I just have ollama over wireguard, and I use litellm to interact with local or remote models programmatically. I use prefect to visualize the workflows. But otherwise its all just python code
Published at
2025-03-01 00:58:27Event JSON
{
"id": "019eebecc2b92f39fa3da4c89376ddb02fe00acb051ab0589a30378cba0664d2",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1740790707,
"kind": 1,
"tags": [
[
"e",
"2276dd12dd459389ced906737c4395673a586c18b19bc1e8555454a1347eb09a",
"ws://192.168.18.7:7777",
"root"
],
[
"e",
"0fc985c31c83acc67ecd138f2620e4d49ba83aa461aa32249b2da9340612be03",
"",
"reply"
],
[
"p",
"818069047e547d85087217e07ea88c684a3c921e9f9ba281d3b0f3e521ad3b87"
]
],
"content": "I just have ollama over wireguard, and I use litellm to interact with local or remote models programmatically. I use prefect to visualize the workflows. But otherwise its all just python code",
"sig": "eb8d6ac780515f7c68e2675c30a7fab1bbfeb1d4d4283e63cfb9308a8d87ea65247e4b0f02aa6694830d7ece3f4378ee56c8bacd7a13f0a2a820dedf6bc265c5"
}
