Chris Adams on Nostr: Over the last few months, I've developed a habit of using nprofile1q…8ssyg's ...
Over the last few months, I've developed a habit of using nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpqf6a33pfyp67y8llhunlhrf855xm47n3fdqymvxfj7yx78c6vqf4sy8ssyg (nprofile…ssyg)'s fantastic llm tool with the growing crop of decent small language models out there.
I include Llama 3.2 3B as one example of an SLM, as I can run it on my 4 year old machine without really noticing it affecting resource usage, until I need to run a query. Even then, it's still using less memory than my browser.
It took me a while to figure out a setup I like, and this might be useful for others.
https://rtl.chrisadams.me.uk/2024/12/how-i-use-llms-neat-tricks-with-simons-llm-command/
I include Llama 3.2 3B as one example of an SLM, as I can run it on my 4 year old machine without really noticing it affecting resource usage, until I need to run a query. Even then, it's still using less memory than my browser.
It took me a while to figure out a setup I like, and this might be useful for others.
https://rtl.chrisadams.me.uk/2024/12/how-i-use-llms-neat-tricks-with-simons-llm-command/