dontbelievethehype on Nostr: You can run 70B models but they are a little bit slow. But everything below works ...
You can run 70B models but they are a little bit slow. But everything below works great.
Published at
2025-01-31 17:54:46Event JSON
{
"id": "d25be245b5e00b798038b4555d3861fa6341f004cbda3e00f42d2ec9be8a1bc9",
"pubkey": "99bb5591c9116600f845107d31f9b59e2f7c7e09a1ff802e84f1d43da557ca64",
"created_at": 1738346086,
"kind": 1,
"tags": [
[
"e",
"535138d81c81d5e3fe9f112edb1399256efb173c870e96b9f5f42145e7c8683d",
"",
"root"
],
[
"e",
"96c4252e567820ad8b1ea13a0652a8727c796a3e1ba5d5e01ddff84724a72806"
],
[
"e",
"bf74e9d31f2c8b1a6c9ed168b172214b1d65ca36c71afbb5c540fc7ca5928757",
"",
"reply"
],
[
"p",
"76c71aae3a491f1d9eec47cba17e229cda4113a0bbb6e6ae1776d7643e29cafa"
],
[
"p",
"99bb5591c9116600f845107d31f9b59e2f7c7e09a1ff802e84f1d43da557ca64"
],
[
"p",
"604e96e099936a104883958b040b47672e0f048c98ac793f37ffe4c720279eb2"
]
],
"content": "You can run 70B models but they are a little bit slow. But everything below works great.",
"sig": "bd35d0f719f99cc95c2d47b280e02b0d89beef767ad7a055a2ea92adf939b7fe513d3975160f799aab2d033adcf982479b7c00fdd60d0d1183037a4055bb1678"
}
