armstrys on Nostr: Very new to exploring this. I’ve used ChatGPT and that’s about it. So far using ...
Very new to exploring this. I’ve used ChatGPT and that’s about it. So far using ollama through docker has been great for running locally. Mostly testing small open models >=8b parameters.
Will see how these small models do on my M1… I imagine they will give me enough of a boost that I won’t choose to pay for something.
What’s your experience been like?
Published at
2024-10-05 01:33:54Event JSON
{
"id": "6f3da8b8c1ef42dfe816cbc01573d38e9df08067b2ca0132c451f6d2ac1e5552",
"pubkey": "c80b5248fbe8f392bc3ba45091fb4e6e2b5872387601bf90f53992366b30d720",
"created_at": 1728092034,
"kind": 1,
"tags": [
[
"e",
"06a394668799cc6713680e98115eb9163bb5f141e9a4434121b1bd00bac877e1",
"",
"root"
],
[
"e",
"b3913326303d6515f8be69d1fdde81410e55e032c6f0a41986462da7245035c1",
"",
"reply"
],
[
"p",
"7bdef7bdebb8721f77927d0e77c66059360fa62371fdf15f3add93923a613229"
],
[
"p",
"1bda7e1f7396bda2d1ef99033da8fd2dc362810790df9be62f591038bb97c4d9"
]
],
"content": "Very new to exploring this. I’ve used ChatGPT and that’s about it. So far using ollama through docker has been great for running locally. Mostly testing small open models \u003e=8b parameters. \n\nWill see how these small models do on my M1… I imagine they will give me enough of a boost that I won’t choose to pay for something. \n\nWhat’s your experience been like?",
"sig": "ffa9bf14a9f631b6d406535407d481a08150c5cfe1b211c5ffc237ed528b143f6a29a6d26b5b3c99157ca8bfa0664ab154cc1cbbcc90a8b8eaa2d04ae716e4fa"
}
