Stefan Judis on Nostr: If you want to block (or at least tell) all the AI bots to not crawl your sites this ...
If you want to block (or at least tell) all the AI bots to not crawl your sites this is a good place to start. 👇
https://darkvisitors.com/ Published at
2024-01-02 08:23:14Event JSON
{
"id": "3ed4b3ab35b8ca6cd740e949fd866cd0ce9600a47b6244748204befe44645bfc",
"pubkey": "7496e045b5117ec8b7a667d160588aa34adf42074194833b6f4793ea1193c0bf",
"created_at": 1704183794,
"kind": 1,
"tags": [
[
"proxy",
"https://front-end.social/users/stefan/statuses/111685389183574911",
"activitypub"
]
],
"content": "If you want to block (or at least tell) all the AI bots to not crawl your sites this is a good place to start. 👇\n\nhttps://darkvisitors.com/\n\nhttps://cdn.masto.host/frontendsocial/media_attachments/files/111/685/389/109/746/054/original/63357db5c73549af.png",
"sig": "9311108ba62972840fe2751b1e6ea5e5c6d4a1bf8cdb8c1b1679574c5eddf012cac780b14e500344ba3be51daf3b07c478a22f1149cdb4e1846010a5724e582f"
}