Raul007 on Nostr: I wish I had 360gb of V/RAM to run the 13B model at 128k context 🫠Nice to see the ...
I wish I had 360gb of V/RAM to run the 13B model at 128k context ðŸ«
Nice to see the context window being pushed though.
Published at
2023-09-01 12:11:53Event JSON
{
"id": "79cd9af4da5352d31eaddcb643aac3eb34a93d0c87033ebafe367d1b97672dad",
"pubkey": "fca3f1847bdda5b29e631edfb8ce0991af688041051dfb6d3bf236880afd1678",
"created_at": 1693570313,
"kind": 1,
"tags": [
[
"e",
"cd91d7562e733ccae38ca37c69e14f708fdf76edcf2649a5bb76aa56f5ff4936",
"",
"reply"
],
[
"p",
"7560e065bdfe91872a336b4b15dacd2445257f429364c10efc38e6e7d8ffc1ff"
]
],
"content": "I wish I had 360gb of V/RAM to run the 13B model at 128k context 🫠\n\nNice to see the context window being pushed though.",
"sig": "160023a466ead57bb3d782de19b4c80556b3c24b653d4f3abd484d8726f3ee68854ae8f8dfa3336429526fcfae54eaf4033e97125b53df5534ff54d2607373af"
}
