Griz, Some Guy on Mastodon on Nostr: npub1e7vnd…5flg9 That actually makes a lot of sense. Like graphics processing, AI ...
npub1e7vndtpf0s9pcg6yxkmvwvfq2g56rg5694nlgthwg7j2hkjgeuwq65flg9 (npub1e7v…flg9) That actually makes a lot of sense. Like graphics processing, AI is processing-intensive, and it's a heck of a lot faster to process in memory. I've usually done audio so 16 gig has been enough, but I'll research that.
Didn't see a setting for the size of the bot's reply, maybe that'd be in the prompt message?
I'm calling mine Falcon, for the model name. Falcon says I'd do better/cheaper to upgrade the graphics card rather than an AI accelerator. Seems reasonable.
Published at
2024-01-18 12:28:47Event JSON
{
"id": "5ccc9ddd726661d194a0bfc77576bfe6d339ed664f0d58e64bff28210116f6a0",
"pubkey": "91370a8e90e04c06a0e68d4b1c057c09dc6e5cebe5da6184f564005cdca3e64b",
"created_at": 1705580927,
"kind": 1,
"tags": [
[
"p",
"cf9936ac297c0a1c234435b6c731205229a1a29a2d67f42eee47a4abda48cf1c",
"wss://relay.mostr.pub"
],
[
"p",
"ece51acfc6c84a5f625a755bed921f6eac6a9daa6f90817047901dbe0231522f",
"wss://relay.mostr.pub"
],
[
"e",
"db96f185f34316fea96f7fc600e585c1ecff4e86b641b92db09721e8699e1d54",
"wss://relay.mostr.pub",
"reply"
],
[
"proxy",
"https://twit.social/users/Grizzlysgrowls/statuses/111776951680056814",
"activitypub"
]
],
"content": "nostr:npub1e7vndtpf0s9pcg6yxkmvwvfq2g56rg5694nlgthwg7j2hkjgeuwq65flg9 That actually makes a lot of sense. Like graphics processing, AI is processing-intensive, and it's a heck of a lot faster to process in memory. I've usually done audio so 16 gig has been enough, but I'll research that.\n\nDidn't see a setting for the size of the bot's reply, maybe that'd be in the prompt message?\n\nI'm calling mine Falcon, for the model name. Falcon says I'd do better/cheaper to upgrade the graphics card rather than an AI accelerator. Seems reasonable.",
"sig": "1589ed28377f7cb0417e7632f904d4a695d38d7f640dd5d7aec17253aab3f1265baeab538d90fe5e4deccf793bf5b6a5f9160243f70cbae887e75e5d1f83cd34"
}
