melvincarvalho on Nostr: I do a little bit of everything. We have a small group of nostriches working on ...

I do a little bit of everything. We have a small group of nostriches working on different strategies and lots of R&D. I try to self host for certain things, especially privacy. But building a machine is quite hard and to get the new 5090 is very tough. One of our group has one of the fastest self built PCs in the world. Yet, still running some models can be a challenge. Another way is to rent GPU. And the final way is to use paid inferencing or an LLM API. As usual it's using the right tool for the right job. We are also all payments people, so we are working on paid agent to agent comms, meaning we can use each other's systems for pay (still in devel). Video iteslf is still quite tough at the self host level. Image much easier. Ultimately self-host is going to grow alot this year.