John Dee on Nostr: I wonder if the increasing use of synthetic data for training is causing them to ...
I wonder if the increasing use of synthetic data for training is causing them to shift towards more average positions on all topics. Whatever values were most common in the original training data would tend to dominate.
Published at
2025-02-01 16:00:48Event JSON
{
"id": "a50d4330ed0efa4aa7c69a844b5ae0c7f469880acdbfa656b07b06c7ded11b7b",
"pubkey": "fe32298e29aab4ec2911c0dbdda485c073f869c5444ee92f7ae247ed20516265",
"created_at": 1738425648,
"kind": 1,
"tags": [
[
"e",
"13952f177b82790b331315db2f369c85a43f89bae5e6b0afb6f3f2f9d34c54c9",
"wss://nostr.wine/",
"root",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1"
],
[
"e",
"13952f177b82790b331315db2f369c85a43f89bae5e6b0afb6f3f2f9d34c54c9",
"wss://nostr.wine/",
"reply",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1"
],
[
"p",
"9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1"
]
],
"content": "I wonder if the increasing use of synthetic data for training is causing them to shift towards more average positions on all topics. Whatever values were most common in the original training data would tend to dominate.",
"sig": "2a28d0ff38de82fc19a0020a28a604f1ccd86d5a9f9b59b2583350f4c9f19466c97025a036c78c475f5a4f3115d49a392c131a70480978bdd2e3b6aeaf3355a2"
}
