What is Nostr?
TheGuySwann / Guy Swann
npub1h8n…rpev
2023-12-02 20:10:51

TheGuySwann on Nostr: So I'm playing with some models using @LMStudioAI, but I can't seem to get context ...

So I'm playing with some models using @LMStudioAI, but I can't seem to get context length longer than 1,500

I downloaded the YaRN Model with supposedly 128k context length, but can't figure out how or where this is applied in its use. Anyone got a good source to dig into this? 🤔🤔
Author Public Key
npub1h8nk2346qezka5cpm8jjh3yl5j88pf4ly2ptu7s6uu55wcfqy0wq36rpev