iefan 🕊️ on Nostr: You can use this website. Go to settings, and choose any model. It will download the ...
You can use this website. Go to settings, and choose any model. It will download the model, keep it in the browser cache, and run it on your native hardware using WebGPU on any device.
They don’t have the latest smaller model yet. I’ll share the link for that later, so you can add it to this web app.
https://chat.webllm.ai/Published at
2025-01-25 23:50:32Event JSON
{
"id": "ef5bcbd187751570f1668a0e542f8dd6f7a6e14f80bc3b6cab2163b1f18b7d8d",
"pubkey": "c6f7077f1699d50cf92a9652bfebffac05fc6842b9ee391089d959b8ad5d48fd",
"created_at": 1737849032,
"kind": 1,
"tags": [
[
"e",
"917454c6bd116aaff5df31d57dac2af596f646701dae2fbae0860f6df30bbc71",
"",
"root"
],
[
"e",
"5b21bccd70bf0602a3ed6850cb680316c4b93369be87b495192b23e54dcd5b68",
"",
"reply"
],
[
"p",
"8829a79aa18928efc9b888590186f24082b45a7a51509aca4d40a20136d69c3a"
],
[
"r",
"https://chat.webllm.ai/"
]
],
"content": "You can use this website. Go to settings, and choose any model. It will download the model, keep it in the browser cache, and run it on your native hardware using WebGPU on any device.\n\nThey don’t have the latest smaller model yet. I’ll share the link for that later, so you can add it to this web app.\nhttps://chat.webllm.ai/",
"sig": "36d2eab85d25bccc8fb10c6e74cb94e24e06ae74a646ba10a544a8dbcb106fc806103a594f38afec64121c4f318758407f282804e7969839739c2bf6f21ebb93"
}
