Daniel Wigton on Nostr: At 70B parameters? 3.3 t/s is equivalent to a fairly fast human typist, but not so ...
At 70B parameters? 3.3 t/s is equivalent to a fairly fast human typist, but not so fast I don't pick and choose what to ask it. Works pretty well with Continue AI. But the default context window in ollama is kinda small if I need it to look at more than a few files.
Published at
2025-03-25 19:37:05Event JSON
{
"id": "3de36222ff3fd001ca1760242d39b9ebe5bbedd00ae93978c0e50c2b525c118d",
"pubkey": "75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a",
"created_at": 1742931425,
"kind": 1,
"tags": [
[
"e",
"0808d872c5db2df9223b86c0a1ac5ef13960cb8123502c7d7259b1ec72f233aa",
"",
"root"
],
[
"e",
"c72d74b91ad005e2a96a280ace21911b0dd466505ec4e420a462be5d0bf08503"
],
[
"e",
"11d65ea8e4a474934a8c4203b341455b783296cb980100ba1d965ad7ceb9c124",
"",
"reply"
],
[
"p",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
]
],
"content": "At 70B parameters? 3.3 t/s is equivalent to a fairly fast human typist, but not so fast I don't pick and choose what to ask it. Works pretty well with Continue AI. But the default context window in ollama is kinda small if I need it to look at more than a few files.",
"sig": "623e76d3f7772bf6df988a58c59a9499261571f3ac9386bb702ae9c29d7a12877079857c9bea5272709c3631c34598ae2256456645216e36b9c407bd893401ce"
}
