TheGuySwann on Nostr: So I'm playing with some models using @LMStudioAI, but I can't seem to get context ...
So I'm playing with some models using @LMStudioAI, but I can't seem to get context length longer than 1,500
I downloaded the YaRN Model with supposedly 128k context length, but can't figure out how or where this is applied in its use. Anyone got a good source to dig into this? 🤔🤔
I downloaded the YaRN Model with supposedly 128k context length, but can't figure out how or where this is applied in its use. Anyone got a good source to dig into this? 🤔🤔