What is Nostr?
Raul007 /
npub1lj3…sxjy
2023-08-25 22:07:08
in reply to nevent1q…hu3r

Raul007 on Nostr: Awesome. I was wondering whether it was worth it to grab some extra system RAM to try ...

Awesome. I was wondering whether it was worth it to grab some extra system RAM to try a 70B model on CPU only, but it runs just as slow as my CPU w/ GPU offloading.

🤷 I'll just have to wait for used 3090s to come down in price.
Author Public Key
npub1lj3lrprmmkjm98nrrm0m3nsfjxhk3qzpq5wlkmfm7gmgszhazeuq3asxjy