Jan Rychter on Nostr: kravietz 🦇 I run these models on a laptop (MacBook Pro with M3 Max), and they run ...
kravietz 🦇 (npub1vz5…qdta) I run these models on a laptop (MacBook Pro with M3 Max), and they run ridiculously fast. Problem is, they output mostly garbage. I tried several 34b models, and they are not even in the same league as GPT-4.
Published at
2024-01-05 10:43:21Event JSON
{
"id": "31dfd1a616564db37cf39b3ab516bcd528b33bbf192994db34228c75bb61dfcb",
"pubkey": "d9b909039ca29a1f23cd56acf9833c5f73fecfba25b3b3791b79a868b3d33760",
"created_at": 1704451401,
"kind": 1,
"tags": [
[
"p",
"60a94a39eef05a48fcb0b214f57ecd9c81ffd70bd7beaa274732ae7ae7dcf0ea",
"wss://relay.mostr.pub"
],
[
"e",
"94c796f0ef094352ac4aea20fe5e8689746242f067ba5352f46b2e40769033de",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://mastodon.social/users/jrychter/statuses/111702927016288542",
"activitypub"
]
],
"content": "nostr:npub1vz555w0w7pdy3l9skg202lkdnjqll4ct67l25f68x2h84e7u7r4qmrqdta I run these models on a laptop (MacBook Pro with M3 Max), and they run ridiculously fast. Problem is, they output mostly garbage. I tried several 34b models, and they are not even in the same league as GPT-4.",
"sig": "d1bfac3ca55ac06e0d1d4256cc9ad0d392a82353f2549068baa4cf37fe4710bd972f1976c9712d5b0367dc31529f378203074017a8765b39b247e298730c2548"
}
