This is how you run LLMs in a privacy preserving sovereign way on your mobile device: ...

2025-02-10 15:20:36

This is how you run LLMs in a privacy preserving sovereign way on your mobile device:

🔸 Install the *ChatterUI* #foss app via Obtanium/Github.
🔸 Go to *HuggingFace* site and download an open-source LLM of your choice (gguf).
🔸 Open the app and import the model.

All your chats will run locally on your device. No accounts required, no internet connection. Tons of customizations.

Many models to choose from, even small mobile-efficient ones from Gemma 2, Llama 3.2, DeekSeek—all will run on your mobile device with decent tokens/s.

#privacy #grapheneos #opsec

Author Public Key

npub12rrvutnfeu9677d4yjytypqccjn0njnm6zkx2j6xyn2uqfw02ldsrl8ty9

Seen on

wss://purplerelay.com wss://relay.nostr.net wss://relay.primal.net

Show more details

Published at

2025-02-10 15:20:36

Kind type

1 Short Text Note

Event JSON

{ "id": "26592ca597b5dda4ae90c8c512365ed3354a7bbc6dde739c0d15cfe71521a430", "pubkey": "50c6ce2e69cf0baf79b52488b20418c4a6f9ca7bd0ac654b4624d5c025cf57db", "created_at": 1739200836, "kind": 1, "tags": [ [ "t", "foss" ], [ "t", "privacy" ], [ "t", "grapheneos" ], [ "t", "opsec" ], [ "r", "https://image.nostr.build/aff805d9287507badfdae77b69c3dbd8c3e91a19b0e2d4e189af3ec4b6f419c4.jpg" ], [ "r", "https://image.nostr.build/2f83bd767f7a8243f69a9352357cfe919e97706036c1816ca1f6523abe431d30.jpg" ], [ "r", "https://image.nostr.build/489eff886ff9bcca7719401464c1fe83ffcdf1cd128f2cf139d921718ab467e8.jpg" ], [ "imeta", "url https://image.nostr.build/aff805d9287507badfdae77b69c3dbd8c3e91a19b0e2d4e189af3ec4b6f419c4.jpg", "x 5018e2237b1cfa6bc4bfeefc86950b805f221272558bb7c0959d12af8736a5c2", "size 90950", "m image/jpeg", "dim 1080x2220", "blurhash [25E$_~q?boy-=xuxuM{4.4n9FIUM|WB%Ms;_3?H-;xuV@Rjt7WBR*M{M{Rk%M%M-=tR%Mt6s;j[", "ox 5018e2237b1cfa6bc4bfeefc86950b805f221272558bb7c0959d12af8736a5c2", "alt " ], [ "imeta", "url https://image.nostr.build/2f83bd767f7a8243f69a9352357cfe919e97706036c1816ca1f6523abe431d30.jpg", "x 3820e1832f1911a06643688179d80b86911303bced08c63e02e3f6cefbd2bc46", "size 82755", "m image/jpeg", "dim 1080x2220", "blurhash [25Esz%MInM{I+xuxuM{?KofWBWB9Way%MWB?cj[WBWBITWB%MaytQaxofay-roft7ayo@t7M{WA", "ox 3820e1832f1911a06643688179d80b86911303bced08c63e02e3f6cefbd2bc46", "alt " ], [ "imeta", "url https://image.nostr.build/489eff886ff9bcca7719401464c1fe83ffcdf1cd128f2cf139d921718ab467e8.jpg", "x c9e7d1e86c0de1e4e9eb012ce4e8f7f95dd25e9a71203e39031da4167f34f39c", "size 99576", "m image/jpeg", "dim 1080x2220", "blurhash [36kP1_3?b-;4mRk%MRjIB4nD%D%_3xu%Lt8WAt7%MRj_3xbt6ogoctQ%Mt6D%9FIUD*?Ij[NFWB", "ox c9e7d1e86c0de1e4e9eb012ce4e8f7f95dd25e9a71203e39031da4167f34f39c", "alt " ] ], "content": "This is how you run LLMs in a privacy preserving sovereign way on your mobile device:\n\n🔸 Install the *ChatterUI* #foss app via Obtanium/Github.\n🔸 Go to *HuggingFace* site and download an open-source LLM of your choice (gguf).\n🔸 Open the app and import the model.\n\nAll your chats will run locally on your device. No accounts required, no internet connection. Tons of customizations.\n\nMany models to choose from, even small mobile-efficient ones from Gemma 2, Llama 3.2, DeekSeek—all will run on your mobile device with decent tokens/s.\n\n#privacy #grapheneos #opsec\n\nhttps://image.nostr.build/aff805d9287507badfdae77b69c3dbd8c3e91a19b0e2d4e189af3ec4b6f419c4.jpg \nhttps://image.nostr.build/2f83bd767f7a8243f69a9352357cfe919e97706036c1816ca1f6523abe431d30.jpg \nhttps://image.nostr.build/489eff886ff9bcca7719401464c1fe83ffcdf1cd128f2cf139d921718ab467e8.jpg\n", "sig": "ec56c32b330ebef70b8bf6f429100218f542ac10bdcb1113d5e9c39ffd33e13d245e6e651d45ce5a3c2d82899100d47ed666833f2a86de9442769ed044fa6b76" }

Skipper on Nostr: This is how you run LLMs in a privacy preserving sovereign way on your mobile device: ...