jb55 on Nostr: from what I understand it just makes it easier to swap models, but it still uses ...
from what I understand it just makes it easier to swap models, but it still uses llama.cpp under the hood.
Published at
2024-12-02 22:00:42Event JSON
{
"id": "dd3993d791050bc073cb6c370a0649cc776d97e1698ea02d4488a98ac286e331",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1733176842,
"kind": 1,
"tags": [
[
"client",
"Damus Notedeck"
],
[
"e",
"5b45958a0ed9f2c516eeb2bb517ea4e89d9e32a0d3ed8e898dcf3e74d863e813",
"",
"root"
],
[
"e",
"03ccfb246637d2624cfc0ba84a9afa99def8ec24b351b851629a9811490a5d5d",
"",
"reply"
],
[
"p",
"bf03bdf659e463e31574aff7698cf83b4cd81ab17829c22f7d5ccf76faacdbbd"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "from what I understand it just makes it easier to swap models, but it still uses llama.cpp under the hood.",
"sig": "654c96597f1ca54e3f0cc4be9648f0f2246ca8309ecffc49d8bc131e03af069cf105cbf308c54523ea0d9d3f3fbe365d9434ad6815cfcd258b6e5e8d02ab83f8"
}