What is Nostr?
Matthew Martin ☑ ✅📛 /
npub1anj…k3c3
2024-03-16 22:22:28
in reply to nevent1q…uwpx

Matthew Martin ☑ ✅📛 on Nostr: npub17907c…m49f9 Dual 30xx card are cheap and last time I did dual cards, finicky ...

npub17907cj76qt085ekrfn58zkk2p40xhwr4g43p26xgjwvh7yuchmssdm49f9 (npub1790…49f9) Dual 30xx card are cheap and last time I did dual cards, finicky to keep working. 40xx very expensive, can run small models very fast, large models not at all. Mac studio with maximum memory or MacBook pro with maximum memory can run large models at "medium" perf. IMHO, for llm work quality matters more that just speed. Dumb 7b models have far more limited applications
Author Public Key
npub1anj34n7xep997cj6w4d7mysld6kx48d2d7ggzuz8jqwmuq332ghs5tk3c3