extended version for the robots.txt User-agent: AI2Bot User-agent: Ai2Bot-Dolma ...

npub1294…upjh

2025-01-06 03:24:30

in reply to nevent1q…k6xp

extended version for the robots.txt
User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ChatGPT-User
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: cohere-ai
User-agent: Diffbot
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: FriendlyCrawler
User-agent: Google-Extended
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: GPTBot
User-agent: iaskspider/2.0
User-agent: ICC-Crawler
User-agent: ImagesiftBot
User-agent: img2dataset
User-agent: ISSCyberRiskCrawler
User-agent: Kangaroo Bot
User-agent: Meta-ExternalAgent
User-agent: Meta-ExternalFetcher
User-agent: OAI-SearchBot
User-agent: omgili
User-agent: omgilibot
User-agent: PanguBot
User-agent: PerplexityBot
User-agent: PetalBot
User-agent: Scrapy
User-agent: Sidetrade indexer bot
User-agent: Timpibot
User-agent: VelenPublicWebCrawler
User-agent: Webzio-Extended
User-agent: YouBot
raw.githubuserc…

Author Public Key

npub1294khcygmzxr8fudt4dany08xnz7w3ufqqf4f835regcwpdwqamq82upjh

Seen on

wss://relay.primal.net

Show more details

Published at

2025-01-06 03:24:30

Kind type

1 Short Text Note

Event JSON

{ "id": "19f761c510bc83bdaf99689be1e08d2f89ff8ff9badb05bf19cb8a2ccfeb5e67", "pubkey": "516b6be088d88c33a78d5d5bd991e734c5e747890013549e341e518705ae0776", "created_at": 1736133870, "kind": 1, "tags": [ [ "p", "15b7758904cd6ec9c4d780aed7cca01019b61be45945dea8a68e2d2322a45ecd", "wss://relay.mostr.pub" ], [ "p", "907c24ac49ddf6682bf12dd49da1b463317cc9c8ee10d958fd7dc1a102562c9e", "wss://relay.mostr.pub" ], [ "p", "08398ac87f7c4d3e61fe3c534b3be40aa1725cdb03684bc49ea9a2848b1f2d09", "wss://relay.mostr.pub" ], [ "p", "58b0ffc91294cea32ac535839cf79605f93ddebdf1322d06f80fbc60b51ac1dc", "wss://relay.mostr.pub" ], [ "p", "e3eedcd0ba49dccfd50580d7b5a056228b80e4748b60245a0a9782247c357344", "wss://relay.mostr.pub" ], [ "p", "8c55c5b251af92ad842811e585a5f7be85bf3e70ba25c5de1223459d83fb6c72", "wss://relay.mostr.pub" ], [ "p", "920b6f9caa22174262b73b7191e3a13d3c737986129fb931e6ee9455d4164bb0", "wss://relay.mostr.pub" ], [ "p", "516b6be088d88c33a78d5d5bd991e734c5e747890013549e341e518705ae0776", "wss://relay.mostr.pub" ], [ "e", "ee02e6129d296d4e70318ed512cf6cfb9c9a220dc05edccfffc2a5a7679ac53b", "wss://relay.mostr.pub", "reply" ], [ "proxy", "https://tupambae.org/objects/0ac89072-8767-7b4c-eeb4-a8d631584824", "activitypub" ] ], "content": "extended version for the robots.txt\nUser-agent: AI2Bot\nUser-agent: Ai2Bot-Dolma\nUser-agent: Amazonbot\nUser-agent: anthropic-ai\nUser-agent: Applebot\nUser-agent: Applebot-Extended\nUser-agent: Bytespider\nUser-agent: CCBot\nUser-agent: ChatGPT-User\nUser-agent: Claude-Web\nUser-agent: ClaudeBot\nUser-agent: cohere-ai\nUser-agent: Diffbot\nUser-agent: DuckAssistBot\nUser-agent: FacebookBot\nUser-agent: FriendlyCrawler\nUser-agent: Google-Extended\nUser-agent: GoogleOther\nUser-agent: GoogleOther-Image\nUser-agent: GoogleOther-Video\nUser-agent: GPTBot\nUser-agent: iaskspider/2.0\nUser-agent: ICC-Crawler\nUser-agent: ImagesiftBot\nUser-agent: img2dataset\nUser-agent: ISSCyberRiskCrawler\nUser-agent: Kangaroo Bot\nUser-agent: Meta-ExternalAgent\nUser-agent: Meta-ExternalFetcher\nUser-agent: OAI-SearchBot\nUser-agent: omgili\nUser-agent: omgilibot\nUser-agent: PanguBot\nUser-agent: PerplexityBot\nUser-agent: PetalBot\nUser-agent: Scrapy\nUser-agent: Sidetrade indexer bot\nUser-agent: Timpibot\nUser-agent: VelenPublicWebCrawler\nUser-agent: Webzio-Extended\nUser-agent: YouBot\nraw.githubuserc…", "sig": "4e4a19896e0f40237ab43a9be4584a92ef0a7e51fdad478916d1b20f6a4ad845072c03067975d172a95ad52f72382c5f39caa130412cb3b8c26c67e363cb9a45" }