aljaz on Nostr: utxo the webmaster 🧑💻 have you tried something that supports tensor ...
utxo the webmaster 🧑💻 (nprofile…8ykj) have you tried something that supports tensor parallelism like https://github.com/turboderp-org/exllamav2 ?
aljaz
npub1al…hg9jp
2025-03-14 19:37:20 UTC
in reply to nevent1q…qsfs
Author Public Key
npub1aljazgxlpnpfp7n5sunlk3dvfp72456x6nezjw4sd850q879rxqsthg9jpPublished at
2025-03-14 19:37:20 UTCEvent JSON
{
"id": "b3e75036206b74b37a9e99315673710c8bd26f23d452bbcef53df0c8325c48e8",
"pubkey": "efe5d120df0cc290fa748727fb45ac487caad346d4f2293ab069e8f01fc51981",
"created_at": 1741981040,
"kind": 1,
"tags": [
[
"p",
"e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb",
"wss://relay.bitcoinpark.com/",
"mention"
],
[
"e",
"38463d49721d6e9072e4f33ad7405e294e15e40c3b1960ed051af4a11658a5a3",
"wss://relay.0xchat.com/",
"root"
],
[
"e",
"40b6858f79356d4edd12c6ab0e4a668ef6d82b1be9e6f377e0a79be1e22c0742",
"wss://relay.0xchat.com/",
"reply"
],
[
"p",
"b9e76546ba06456ed301d9e52bc49fa48e70a6bf2282be7a1ae72947612023dc"
],
[
"p",
"e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb"
],
[
"r",
"wss://nos.lol/"
],
[
"r",
"wss://nostr-pub.wellorder.net/"
],
[
"r",
"wss://nostr.bitcoiner.social/"
],
[
"r",
"wss://nostr.oxtr.dev/"
],
[
"r",
"wss://nostr.wine/"
],
[
"r",
"wss://nostr.mom/"
],
[
"r",
"wss://premium.primal.net/"
],
[
"r",
"wss://relay.damus.io/"
],
[
"r",
"wss://relay.disobey.dev/",
"read"
],
[
"r",
"wss://relay.mostr.pub/"
],
[
"r",
"wss://offchain.pub/"
],
[
"r",
"wss://relay.nostr.band/"
],
[
"r",
"wss://relay.nostr.bg/"
],
[
"r",
"wss://relay.nostr.net/"
],
[
"r",
"wss://relay.primal.net/"
],
[
"r",
"wss://relay.snort.social/"
],
[
"r",
"wss://wot.nostr.net/"
]
],
"content": " nostr:nprofile1qyw8wumn8ghj7un9d3shjtnzd96xxmmfdecxzunt9e3k7mf0qy2hwumn8ghj7un9d3shjtn4w3ux7tn0dejj7qpqutx00neqgqln72j22kej3ux7803c2k986henvvha4thuwfkper4sau8ykj have you tried something that supports tensor parallelism like https://github.com/turboderp-org/exllamav2 ? ",
"sig": "aba97386200c488067c61e35c33603b747c445037c594e97838cc5363fc8c39204dece28ae9f8caa06ad24d7caf142ef3ec83e5a6129bdb0f5cf0355499b7e0d"
}