LNRoulette on Nostr: not sure about that My M3 sweats hard on llama3 70b Think we are 3 years from self ...
not sure about that
My M3 sweats hard on llama3 70b
Think we are 3 years from self hosting. models will get smaller and more task specific and processors will get better
It's a bit daft that the model I use for coding also knows ancient Greek and sumarian for example
Published at
2024-10-10 00:57:02Event JSON
{
"id": "041d20df689c51269809ad490ce5fcc8e93098fdc70c7385c6349a479e269146",
"pubkey": "61594d714aa94fe551f604123578c4a6592145f4228ad8601224b1b89ce401b0",
"created_at": 1728521822,
"kind": 1,
"tags": [
[
"p",
"44dc1c2db9c3fbd7bee9257eceb52be3cf8c40baf7b63f46e56b58a131c74f0b"
],
[
"p",
"0689df5847a8d3376892da29622d7c0fdc1ef1958f4bc4471d90966aa1eca9f2"
],
[
"e",
"5b93ec7b7c5e80d91abf9950d596dba7b0c5755f09271caa1381ddce3f5f729f",
"",
"root"
],
[
"e",
"dc7b60eaff0ee00973ebbd756bc5acc4a4cd1a98e84838837775d5330c0d5496",
"",
"reply"
]
],
"content": "not sure about that \n\nMy M3 sweats hard on llama3 70b\n\nThink we are 3 years from self hosting. models will get smaller and more task specific and processors will get better \n\nIt's a bit daft that the model I use for coding also knows ancient Greek and sumarian for example ",
"sig": "bda17861dfa36c58155510d85b036e40a40a32ba3ed575b1e339d31f75f802bb9cf6fee7350a5476a07e84b50aaff1d26b5b8e4303115167ad9e5b7235bdc1c5"
}