James Gleick on Nostr: This is an under-appreciated point about using LLMs to summarize text (turning a ...
This is an under-appreciated point about using LLMs to summarize text (turning a longer text into a shorter text that maintains the essence of the original). Making summaries is hard to do well! It requires understanding and subtlety.
Making a BAD summary is an easy task for an LLM, which flattens everything probabilistically. People using these cheap tools are going to be throwing a lot of babies out with a lot of bathwater and never even knowing it.
https://infosec.exchange/@david_chisnall/113085164920773681Published at
2024-09-05 21:52:11Event JSON
{
"id": "492eeb149f8b35c9e4ea15bfd3a5962952b55692102911a242347c8ecd9e833c",
"pubkey": "1f2544e4240abab2f7e08416dc39322530c665f2d22f9932fa03a4317f739c71",
"created_at": 1725573131,
"kind": 1,
"tags": [
[
"proxy",
"https://mas.to/@gleick/113087160758969663",
"web"
],
[
"proxy",
"https://mas.to/users/gleick/statuses/113087160758969663",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mas.to/users/gleick/statuses/113087160758969663",
"pink.momostr"
],
[
"-"
]
],
"content": "This is an under-appreciated point about using LLMs to summarize text (turning a longer text into a shorter text that maintains the essence of the original). Making summaries is hard to do well! It requires understanding and subtlety.\n\nMaking a BAD summary is an easy task for an LLM, which flattens everything probabilistically. People using these cheap tools are going to be throwing a lot of babies out with a lot of bathwater and never even knowing it. https://infosec.exchange/@david_chisnall/113085164920773681",
"sig": "6a3bed1bfdf97bfabe3d62bd34057755143660e932c7aa48f23f9880d02b4afdf6fb4d9d4afcf66d5b58f67f69c437f4be8e514f8fdaec88aad9e4e2f038bc23"
}