ynniv on Nostr: Secure, Correct, then Fast (a software take on the Vitruvian Triad). Inference ...
Secure, Correct, then Fast (a software take on the Vitruvian Triad). Inference performance has gotten orders of magnitude faster since llama.cpp, and it continues to get faster.
Published at
2024-11-17 13:14:37Event JSON
{
"id": "259ad0583b600f537bddc01d058fa39a60c3cfc6f4855bd95403101d30167a78",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1731849277,
"kind": 1,
"tags": [
[
"e",
"4e92e4c01706c138719a54464aefa28f363d651c9a4b284864af61894d3c6d4b",
"",
"root"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "Secure, Correct, then Fast (a software take on the Vitruvian Triad). Inference performance has gotten orders of magnitude faster since llama.cpp, and it continues to get faster.",
"sig": "bcd6c9575a07ca226ef64f14a108d3b7673b9335c6fac6a7a0cb9f4a9e4183dc7f433b176769c57425ccbe635a89af3866d9eb83d15a941ffbec263a3aa06d6d"
}
