Mauve 👁💜 on Nostr: Getting output data out of an LLM outside of raw chat interfaces is like scooping ...
Getting output data out of an LLM outside of raw chat interfaces is like scooping water with a leaky bucket. You need to plug more and more holes and add extra buckets to catch the spills. Structured JSON can help for a lot of cases but it makes the text generation less capable.
Published at
2025-01-11 01:46:50Event JSON
{
"id": "a5809aac6a4032bdc02f4356f55bfa061c70f4a1679e95c756efd61004f72d21",
"pubkey": "ca6770df24e21d6765c41a491f129fadc55ec34219c9ed90e5b18f7714bb0e70",
"created_at": 1736560010,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.mauve.moe/users/mauve/statuses/113807196879781915",
"activitypub"
]
],
"content": "Getting output data out of an LLM outside of raw chat interfaces is like scooping water with a leaky bucket. You need to plug more and more holes and add extra buckets to catch the spills. Structured JSON can help for a lot of cases but it makes the text generation less capable.",
"sig": "7cf033f23e7b99217ba543aa31bc19a33cdc8647dcb06e6f2295fcdd172f4e3c9f3fbffd6590a70789bf2a911a2e4e88d748c13372f9fa782a329db5d735ae18"
}
