Sam Howell on Nostr: I've been playing around with locally hosted #LLMs using the #Ollama #CLI tool. I've ...
I've been playing around with locally hosted #LLMs using the #Ollama #CLI tool. I've mostly been using models like mistral and dolphin-coder for assistance with textual ideas and issues. More recently I've been using the llava visual model via some simple #Bash #scripting, looping through images and creating description files. I can then grep those files for key words and note the associated filenames. Powerful stuff!
Published at
2024-03-24 14:08:47Event JSON
{
"id": "c3ebba66fe118588056e83228dc092aa477246d715e23210195c02c033885dff",
"pubkey": "df46b7d3b3f5046e237c51e6ea56ed2ac18c8ba569641ff2bfe26a51e8ff468f",
"created_at": 1711289327,
"kind": 1,
"tags": [
[
"t",
"llms"
],
[
"t",
"ollama"
],
[
"t",
"cli"
],
[
"t",
"bash"
],
[
"t",
"scripting"
],
[
"proxy",
"https://fosstodon.org/users/5am/statuses/112151057382873018",
"activitypub"
]
],
"content": "I've been playing around with locally hosted #LLMs using the #Ollama #CLI tool. I've mostly been using models like mistral and dolphin-coder for assistance with textual ideas and issues. More recently I've been using the llava visual model via some simple #Bash #scripting, looping through images and creating description files. I can then grep those files for key words and note the associated filenames. Powerful stuff!",
"sig": "476b234bc7ab2b492a85680c302ce0700663f6d2655194253e43d17aa5ba476341264e1a81932326dfd7c23d43dbe1be8e819d239528345c0263cd30f685366b"
}
