Mauve 👁💜 on Nostr: Fun observation about local #LLM setups. They're typically trained to do one shot ...
Fun observation about local #LLM setups. They're typically trained to do one shot responses to everything, e.g. generating an entire app in one go, but the smaller ones are too stupid to do this successfully and need to be coaxed into doing multi-shot generation. Half my prompt is effectively "Don't write the rest of the code yet, just do this small part for now".
But yeah I've got quen2.5-coder:7b generating lil web apps now from basic prompts for #agregore
Published at
2024-10-25 20:45:04Event JSON
{
"id": "d42178323f63170ded70fafff8cdbfffa548e351d6e900c958ceb21e1c36fcc5",
"pubkey": "ca6770df24e21d6765c41a491f129fadc55ec34219c9ed90e5b18f7714bb0e70",
"created_at": 1729889104,
"kind": 1,
"tags": [
[
"t",
"LLM"
],
[
"t",
"Agregore"
],
[
"proxy",
"https://mastodon.mauve.moe/users/mauve/statuses/113370012343636493",
"activitypub"
]
],
"content": "Fun observation about local #LLM setups. They're typically trained to do one shot responses to everything, e.g. generating an entire app in one go, but the smaller ones are too stupid to do this successfully and need to be coaxed into doing multi-shot generation. Half my prompt is effectively \"Don't write the rest of the code yet, just do this small part for now\".\n\nBut yeah I've got quen2.5-coder:7b generating lil web apps now from basic prompts for #agregore",
"sig": "cbf79b783af712d93bb6e670026eccbcbc6de7d969db3cfa0ff749f5e7dadad408a990b9cb3073b6b72e2d432a58d76ca226b20fd5edef5c96f24b1b0ec16a03"
}
