James Cridland on Nostr: 25,000 requests yesterday from a bot called "Google-Podcast", to URLs explicitly ...
25,000 requests yesterday from a bot called "Google-Podcast", to URLs explicitly forbidden in robots.txt and in X-Robots-Tag.
I have deployed the firewall block of doom against it, whatever it is.
Published at
2024-09-10 01:54:11Event JSON
{
"id": "d6d42938d4f4914c2a1c305137f279a39a9a758f816f0652093c508dfd5f9f9f",
"pubkey": "452fa1bb618154a61b5b88d325446577ed6095a21bb29e1049b4acb04d2e61bb",
"created_at": 1725933251,
"kind": 1,
"tags": [
[
"proxy",
"https://bne.social/users/james/statuses/113110761595904912",
"activitypub"
]
],
"content": "25,000 requests yesterday from a bot called \"Google-Podcast\", to URLs explicitly forbidden in robots.txt and in X-Robots-Tag.\n\nI have deployed the firewall block of doom against it, whatever it is.",
"sig": "ecb4d0047005697f69fb8c0567abe3cc10ff636ef9e9d71a643ea6b74500a9fe560d2212ad96f6bd15aaa667d9f69340f124d03ccabe92eaea638d5364666844"
}
