redlegion on Nostr: I suppose if you bought your own stack of H100's you could run models on your own ...
I suppose if you bought your own stack of H100's you could run models on your own hardware and you wouldn't have to worry that much about token limits and whatnot. You'd just be stuck if you managed to max out the capabilities of your on hand hardware and didn't have a fallback.
Published at
2024-10-31 02:30:58Event JSON
{
"id": "ebcacf3ddb5421665ddcbe6cda8538d99735b3fe35d31566b36f98df0b7a2030",
"pubkey": "3a0865405237f71d9e914e2ef15791553d84afee8ee6a57cb8f753ca3c10cbe4",
"created_at": 1730341858,
"kind": 1,
"tags": [],
"content": "I suppose if you bought your own stack of H100's you could run models on your own hardware and you wouldn't have to worry that much about token limits and whatnot. You'd just be stuck if you managed to max out the capabilities of your on hand hardware and didn't have a fallback.",
"sig": "f12b0f02c0618a9e1a3d69e53bb4c1049adc00512b6f377550bd4849d33205a240ca29e91d73a051f90fa824bbe8f2d707327b7286d74708e5af7a22c3d80261"
}
