What is Nostr?
iefan 🕊️
npub1cmm…lr6f
2024-10-31 12:21:17
in reply to nevent1q…gs26

iefan 🕊️ on Nostr: At the moment, it functions with llama.c via any terminal. Once it's quantized, you ...

At the moment, it functions with llama.c via any terminal. Once it's quantized, you should be able to use it with mlc as well.

I will also integrate it into Aithena. This will allow you to run it locally in your browser on any device without sacrificing performance.
Author Public Key
npub1cmmswlckn82se7f2jeftl6ll4szlc6zzh8hrjyyfm9vm3t2afr7svqlr6f