Chris Coyier on Nostr: That instinct so many of you smart people had, *why bother with a *`robots.txt`* file ...
That instinct so many of you smart people had, *why bother with a *`robots.txt`* file to block the bots they won't honor it anyway,* was absolutely correct.
I guess it's pretty obvious when they tell you how to "block" them only after they've drank your milkshake.
Published at
2024-06-23 11:53:19Event JSON
{
"id": "e48f9d4f3fd8152d7c608b1cf1282af08af42a152ebe9c3f6aea301573444273",
"pubkey": "5bdcf74e4c5fe59d35c5aafea27fc180237ca2f0028c933318615a48d13e0c2a",
"created_at": 1719143599,
"kind": 1,
"tags": [
[
"proxy",
"https://front-end.social/@chriscoyier/112665794939056821",
"web"
],
[
"proxy",
"https://front-end.social/users/chriscoyier/statuses/112665794939056821",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://front-end.social/users/chriscoyier/statuses/112665794939056821",
"pink.momostr"
],
[
"expiration",
"1721848397"
]
],
"content": "That instinct so many of you smart people had, *why bother with a *`robots.txt`* file to block the bots they won't honor it anyway,* was absolutely correct. \n\nI guess it's pretty obvious when they tell you how to \"block\" them only after they've drank your milkshake.",
"sig": "c9f2b76b57b25365348dd8c3a10964f7a97f86a800c6b3caa64bcdc059a3515ad7d2636a6009e42f3cbeb0300a6659662207f33502b824a94e9f827fd260e8a7"
}
