Alan Siefert on Nostr: I keep thinking there might be a point when the efficiency gains that let the smaller ...
I keep thinking there might be a point when the efficiency gains that let the smaller models keep up with the big ones run out (as the big players adopt these too), then the only way to match capability will be to have nearly the same 2 Trillion or whatever parameter size. Hope open source keeps up! 🙏
Published at
2025-01-27 17:48:23Event JSON
{
"id": "0c51cbf23373a77e3f02070773c1d94864978b42baff0e84c04f3d3921a29d64",
"pubkey": "f26606e331f128325ec99cd38782edbec134a5f911ea9fada7adce2ca9015b16",
"created_at": 1738000103,
"kind": 1,
"tags": [
[
"e",
"3b710aacc6025bd0ed710883ae66d8312b97ed3a2634a46e6fb4000568e514d7",
"wss://pyramid.fiatjaf.com",
"root"
],
[
"p",
"f8e6c64342f1e052480630e27e1016dce35fc3a614e60434fef4aa2503328ca9"
]
],
"content": "I keep thinking there might be a point when the efficiency gains that let the smaller models keep up with the big ones run out (as the big players adopt these too), then the only way to match capability will be to have nearly the same 2 Trillion or whatever parameter size. Hope open source keeps up! 🙏",
"sig": "e75ea5910c4046560190522feb4c3cdb896e002cf4479ea705f02a8686e163c573a0cd1a7675e4d91e2f673f6fe5106e5351d58d55a82104aa02403bb3034cd2"
}
