just a heads up to anybody who does not want to be part of yet another "research ...

anime graf mays 🛰️🪐 /

npub108z…dkr5

2023-10-29 18:32:37

just a heads up to anybody who does not want to be part of yet another "research project" into fediverse, in this case defederations

these people are attempting to scrape the /timelines/local and /api/v1/timelines/public routes to scrape public data. if you do not want these, you can block their user agent in nginx/cloudflare/etc. we already prevent access to /timelines/* by unauthenticated users so this wasn't an issue for us. here is a link to the project and their ip/user agents from our logs

wiki.communitydata.science/CommunityData:Fediverse_research

```
129.105.31.75 - - [25/Oct/2023

20:39 +0000] "GET /api/v1/timelines/public?limit=1 HTTP/2.0" 401 52 "-" "https://wikicommunitydata.science/CommunityData:Fediverse_research";
129.105.31.75 - - [25/Oct/2023

20:45 +0000] "GET /api/v1/timelines/public?limit=1 HTTP/2.0" 401 52 "-" "https://wikicommunitydata.science/CommunityData:Fediverse_research";
129.105.31.75 - - [25/Oct/2023

20:52 +0000] "GET /api/v1/timelines/public?limit=1 HTTP/2.0" 401 52 "-" "https://wikicommunitydata.science/CommunityData:Fediverse_research";
129.105.31.75 - - [25/Oct/2023

20:58 +0000] "GET /api/v1/timelines/public?limit=1 HTTP/2.0" 401 52 "-" "https://wikicommunitydata.science/CommunityData:Fediverse_research";
129.105.31.75 - - [25/Oct/2023

21:03 +0000] "GET /api/v1/timelines/public?limit=1 HTTP/2.0" 401 52 "-" "https://wikicommunitydata.science/CommunityData:Fediverse_research";
```

Author Public Key

npub108zt8c43ulvdwnax2txurhhr07wdprl0msf608udz9rvpd5l68ascvdkr5

Show more details

Published at

2023-10-29 18:32:37

Kind type

1 Short Text Note

Event JSON

{ "id": "8990c4a6f9ea83d87eec51d274fe00629612210b9b39fae687dcbe5d234f97aa", "pubkey": "79c4b3e2b1e7d8d74fa652cdc1dee37f9cd08fefdc13a79f8d1146c0b69fd1fb", "created_at": 1698604357, "kind": 1, "tags": [ [ "emoji", "02", "https://poa.st/emoji/custom/02.png" ], [ "proxy", "https://poa.st/objects/d6139b1f-05db-46ff-8b83-7a738d913131", "activitypub" ] ], "content": "just a heads up to anybody who does not want to be part of yet another \"research project\" into fediverse, in this case defederations\n\nthese people are attempting to scrape the /timelines/local and /api/v1/timelines/public routes to scrape public data. if you do not want these, you can block their user agent in nginx/cloudflare/etc. we already prevent access to /timelines/* by unauthenticated users so this wasn't an issue for us. here is a link to the project and their ip/user agents from our logs \n\nwiki.communitydata.science/CommunityData:Fediverse_research\n\n```\n129.105.31.75 - - [25/Oct/2023:02:20:39 +0000] \"GET /api/v1/timelines/public?limit=1 HTTP/2.0\" 401 52 \"-\" \"https://wikicommunitydata.science/CommunityData:Fediverse_research\"\n129.105.31.75 - - [25/Oct/2023:02:20:45 +0000] \"GET /api/v1/timelines/public?limit=1 HTTP/2.0\" 401 52 \"-\" \"https://wikicommunitydata.science/CommunityData:Fediverse_research\"\n129.105.31.75 - - [25/Oct/2023:02:20:52 +0000] \"GET /api/v1/timelines/public?limit=1 HTTP/2.0\" 401 52 \"-\" \"https://wikicommunitydata.science/CommunityData:Fediverse_research\"\n129.105.31.75 - - [25/Oct/2023:02:20:58 +0000] \"GET /api/v1/timelines/public?limit=1 HTTP/2.0\" 401 52 \"-\" \"https://wikicommunitydata.science/CommunityData:Fediverse_research\"\n129.105.31.75 - - [25/Oct/2023:02:21:03 +0000] \"GET /api/v1/timelines/public?limit=1 HTTP/2.0\" 401 52 \"-\" \"https://wikicommunitydata.science/CommunityData:Fediverse_research\"\n```", "sig": "460f969cafed85873eec40d09e6e0169d224f918055593ac1af39cf380437091b765a67ba289a28d290c840b2ffc2c00b7c2134fe1bfc4b77795e4dc3fb1b76b" }