nostr_cn_dev on Nostr: (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot) ...
(KHTML, like Gecko; compatible; GPTBot/1.2; +
https://openai.com/gptbot) openai的爬虫怎么 不看robots.txt规则,我设置的间隔3秒,google,亚马逊都遵守,他不遵守;不间断的抓信息。搞的我NostrHTTP 经常满了。
Published at
2025-02-08 01:12:03Event JSON
{
"id": "f073ab5dabc67ec95e530bc5b7d8ef264921383d7f65ee3d5551ca4ea2c0665a",
"pubkey": "fd06f542bc6c06a39881810de917e6c5d277dfb51689a568ad7b7a548d6d54cd",
"created_at": 1738977123,
"kind": 1,
"tags": [
[
"client",
"Yakihonne",
"31990:20986fb83e775d96d188ca5c9df10ce6d613e0eb7e5768a0f0b12b37cdac21b3:1700732875747"
]
],
"content": "(KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot) openai的爬虫怎么 不看robots.txt规则,我设置的间隔3秒,google,亚马逊都遵守,他不遵守;不间断的抓信息。搞的我NostrHTTP 经常满了。",
"sig": "2157c0e6461854053c20c54fe7ab4e3916fbb8540a89b0698097b6c1fdf4c8a392471e2ddc84631dea336d28829ca79a68fdc76b201bd99c74a91f48cdccda89"
}