Large Heydon Collider on Nostr: Does anyone know if crawlers (I'm thinking AI firms scraping my site) tend to read ...
Does anyone know if crawlers (I'm thinking AI firms scraping my site) tend to read the source or, instead, the DOM, with all the JS manipulations? I guess probably the latter these days but don't know.
Published at
2024-06-16 08:07:27Event JSON
{
"id": "b3933c6b2d5bb4b943f203f2f51314190a79b599abec050708d7f4e2dd236d0d",
"pubkey": "b713f4e1c064eae8a774eeb5b858b2731d365765db0beb393e622ea3c6a6dafb",
"created_at": 1718525247,
"kind": 1,
"tags": [
[
"proxy",
"https://front-end.social/users/heydon/statuses/112625270628938475",
"activitypub"
]
],
"content": "Does anyone know if crawlers (I'm thinking AI firms scraping my site) tend to read the source or, instead, the DOM, with all the JS manipulations? I guess probably the latter these days but don't know.",
"sig": "0f8a152901c57460005e83b03853351e3297f8a0ebade6560116e847ad9d59fecb2fbcf5411dcd444c9c94b25eba7c3efe3cc1c4bbfacb0e3a008fdee3f42ec3"
}
