jb55 on Nostr: I think max on m4 mbp is 128gb. This is just nuts. I wonder how fast inference is on ...
I think max on m4 mbp is 128gb. This is just nuts. I wonder how fast inference is on 405b models
Published at
2025-03-06 00:47:51Event JSON
{
"id": "8c968d46a16b63050db6664071dda9193ec3cd49e2ab52db45cc76823d3e25f9",
"pubkey": "32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245",
"created_at": 1741222071,
"kind": 1,
"tags": [
[
"e",
"1ccb4696a5bfc52e772953c2c77c91d388f2bdc1983a40c2714680a96f0afe14",
"",
"root"
],
[
"e",
"01096973c27a161314b6cf05e0791f3f45d98ff25df0ef58c771a4bac8aba63a",
"",
"reply"
],
[
"p",
"d3d74124ddfb5bdc61b8f18d17c3335bbb4f8c71182a35ee27314a49a4eb7b1d"
]
],
"content": "I think max on m4 mbp is 128gb. This is just nuts. I wonder how fast inference is on 405b models",
"sig": "a2798012b05c61b5388d067ace3781ccabfa904d869acd2ef5f0e1d0df570c143602b77349845968423ca9c5edc53e15d09d3119d6811f4139c001b0c2459320"
}
