What is Nostr?
pluja
npub1jh4…tj6k
2023-03-12 20:03:29

pluja on Nostr: I have successfully run the #LLaMA LLM (from Facebook) locally on my GNU/Linux laptop ...

I have successfully run the #LLaMA LLM (from Facebook) locally on my GNU/Linux laptop using llama.cpp and I have achieved better results and performance than what I expected. It was the 7B model and I was also able to run the 13B model. You can expect much better results with larger models!

It is exciting to see progress towards the possibility of a self-hosted #ChatGPT that runs locally.

https://github.com/ggerganov/llama.cpp
Author Public Key
npub1jh4qu2g5e49syrwh293q8q90xeklvdx47pnj5vyca2tkljed08us0ctj6k