ynniv on Nostr: I started with a P40, then added a 3090. 48GB enough to run 70B models, but it might ...
I started with a P40, then added a 3090. 48GB enough to run 70B models, but it might be time to add a 4090 as well.
ynniv /
npub12ak…6fdh
2025-01-30 19:00:50
in reply to nevent1q…gl8t
Author Public Key
npub12akj8hpakgzk6gygf9rzlm343nulpue3pgkx8jmvyeayh86cfrus4x6fdhPublished at
2025-01-30 19:00:50Event JSON
{
"id": "6e8cdcef13498438463da6a9a203c29e00f86ee5b9fceba989e96b1eaa838424",
"pubkey": "576d23dc3db2056d208849462fee358cf9f0f3310a2c63cb6c267a4b9f5848f9",
"created_at": 1738263650,
"kind": 1,
"tags": [
[
"e",
"2922305f6cf0d36a0453d8c92fecc08706db8b1575e1cc8a8f9e70d4f44b31c0",
"",
"root"
],
[
"e",
"9313af3f3c593c249f6b4f88b5f7e8b22cd6682afbd679561188c94f0bfa85b8",
"",
"reply"
],
[
"p",
"32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"
],
[
"p",
"e3aefda887252a72cee3578d33b2dcd90e9fe53b8bed6347ef5e26f74211adbb"
]
],
"content": "I started with a P40, then added a 3090. 48GB enough to run 70B models, but it might be time to add a 4090 as well.",
"sig": "cea20d7a9f98bdcdbd9f8d5e70bbda3f75d40d829a00ff1edc92c8bbc8a60367edadbe5a0f914b814df394940b17a6bfeb89f6cd04c00e3b67e16d542e137255"
}