adamkarnacz on Nostr: Hi mate. I’m running 14B on a MacBook Pro M3 Max. It’s pretty fast but I should ...
Hi mate. I’m running 14B on a MacBook Pro M3 Max. It’s pretty fast but I should probably run the 32b.
I’m also running Llama 70B, it works but it’s a bit slow.
Published at
2025-02-04 15:23:39Event JSON
{
"id": "e5fec8f9d1ecad44e355315a8ce34457c0990d650ed5ca73df3731462e69b9d1",
"pubkey": "8712b369e906a3925f60000c0a9c12de53c229f6b60ee68692d4b73840625af9",
"created_at": 1738682619,
"kind": 1,
"tags": [
[
"e",
"65b0825b97f5d7d43d570469a0d7600360f3067838a38c3e4005d0d77aa0d58c",
"",
"root"
],
[
"p",
"971615b70ad9ec896f8d5ba0f2d01652f1dfe5f9ced81ac9469ca7facefad68b"
]
],
"content": "Hi mate. I’m running 14B on a MacBook Pro M3 Max. It’s pretty fast but I should probably run the 32b. \n\nI’m also running Llama 70B, it works but it’s a bit slow.",
"sig": "9e3be71be7b5bc6ba586dac46284b48d53de9b0295e062ee770c68c333b5175bf316a865ad78ba1d2d2a89c64dff75cd6a03b7f0745e91955474cd336e5d3781"
}
