Marks on Nostr: yep, it's all tradeoffs. in general, local models, especially on a phone, are slower ...
yep, it's all tradeoffs. in general, local models, especially on a phone, are slower than the models run in the cloud. they also cause the phone to get hot if used for long periods of time and use up the battery quicker. they can be great for specific use cases though, i use them myself.
Published at
2025-02-27 21:58:53Event JSON
{
"id": "03953460c8b35e6c96785b282fac8d03c1257f8e36dfca03c893e5c64192140f",
"pubkey": "8ea485266b2285463b13bf835907161c22bb3da1e652b443db14f9cee6720a43",
"created_at": 1740693533,
"kind": 1,
"tags": [
[
"e",
"9e9d4c6ff926633555b85d2b2fb4eefdaed6a1fdbfbce81ebd75cce27d102027",
"ws://192.168.18.7:7777",
"root"
],
[
"e",
"515ccf56eac7acfa464ab7936f81ee2c1720a6a759fd845da83dcd5359e2c11f",
"ws://192.168.18.7:7777",
"reply"
],
[
"p",
"f6900e6b42a83a6d66589714de49ac86919c6464857d9e164b953bcf9c7e939d"
],
[
"p",
"97f848adcc4c6276685fe48426de5614887c8a51ada0468cec71fba938272911"
],
[
"p",
"7776c32d4b1d1e8bf2a96babeb43ad9ade157bd363d89b87fb63e6f145558888"
]
],
"content": "yep, it's all tradeoffs. in general, local models, especially on a phone, are slower than the models run in the cloud. they also cause the phone to get hot if used for long periods of time and use up the battery quicker. they can be great for specific use cases though, i use them myself.",
"sig": "e153bbf594f6165d9e5a2fd8f9a501e9e6195087c96062c5580e3fe0cc0a2cfdaee56f0cbf1f62308bcabf39b60d61e235708df007feedf85f5d4d3953908fce"
}
