Comment on The Open-Source Software Saving the Internet From AI Bot Scrapers

<- View Parent
who@feddit.org ⁨1⁩ ⁨day⁩ ago

Interesting. Judging by that option’s name, it seems to refer to use of the HTML <meta> tag to refresh a page.

developer.mozilla.org/en-US/docs/…/http-equiv

Neither this tag nor using it for refresh is new at all. I don’t think I’ve seen it used to detect bots, though. I wonder what Anubis is doing here.

source
Sort:hotnewtop