YawningGoat on Nostr: For anyone wanting to run a local LLM on their phone I recommend Phi-3.5 Mini: ...
Published at
2024-10-05 18:27:52Event JSON
{
"id": "ff3d741fa8492c965817787dbb5ece304435223b7aba3f2b64b835d334321a7b",
"pubkey": "8c430bdaadc1a202e4dd11c86c82546bb108d755e374b7918181f533b94e312e",
"created_at": 1728152872,
"kind": 1,
"tags": [
[
"imeta",
"url https://image.nostr.build/610660c0fefbeb813555bb243720182a8461c7635a373ff2c3872a3c066e2cc3.jpg",
"blurhash e~NAn{jbRjfQRjofj[fQfQfQ00j@ofj[ofayfQfQayfQD%ayj[fQj[",
"dim 2048x1152"
],
[
"r",
"https://huggingface.co/microsoft/Phi-3.5-mini-instruct"
],
[
"r",
"https://image.nostr.build/610660c0fefbeb813555bb243720182a8461c7635a373ff2c3872a3c066e2cc3.jpg"
]
],
"content": "For anyone wanting to run a local LLM on their phone I recommend Phi-3.5 Mini:\nhttps://huggingface.co/microsoft/Phi-3.5-mini-instruct\n\nFor me it’s the best compromise between speed and intelligence that can run on most modern phones. https://image.nostr.build/610660c0fefbeb813555bb243720182a8461c7635a373ff2c3872a3c066e2cc3.jpg ",
"sig": "2f7ef8bae2cfb968e8ae6d53a69bee0bc7597963515cde93f047f92b567501ba8a7308b0c0b4b85456f58d8b169561b21eaafa65b805998d49bf5b7b9fe6d07c"
}
