jb55 on Nostr: still a pain to run these models locally. when you do run them locally they max out ...
still a pain to run these models locally. when you do run them locally they max out your vram. RAG use cases are super interesting though. I've always wanted to build a local RAG personal assistant that can search my calendar, emails and nostr notes to find things. just gotta find time to play with it.
quoting note1dml…nqv9This new stuff people are doing with Open AI’s Canvas and Operator feels like a major shift of how we build software.
Look at these videos: https://x.com/minchoi/status/1883554868293779898
And then there’s Deepseek’s new R1 model which is open source, can run on a decent desktop computer, and is better than anything openAI has done with regards to coding… almost as good as claude sonnet… I put $10 in to deepseek and have been using it a lot, only to have spent a few cents!
This stuff is improving so fast, and the cost is dropping so much… it’s hard to keep up.
Look at this, you can run your own RAG at o1 levels using deepseek r1!
https://lightning.ai/akshay-ddods/studios/compare-deepseek-r1-and-openai-o1-using-rag
I think we’re seeing Open Source win against big proprietary tech platforms, and it really makes me feel better about the AI future.
One question here, is why aren’t we talking more about what we can do with it on Nostr? I know folks are excited about bitcoin, which is cool, but look at what we can start doing with the AI… Who’s talking about it on Nostr? How do we use AI and these. emerging open models in building / using nostr… i know we’ve got DVM’s but that’s kind of a limited job request system.