Comment on The Future of Forums is Lies, I Guess

<- View Parent
t3rmit3@beehaw.org ⁨1⁩ ⁨week⁩ ago

I think Anubis is really focused on scraper-bots feeding AI models, rather than posting bots. It’s based on requests to non-standard endpoints in your own app, which you specify for Anubis in a couple places (e.g. leaving out of /robots.txt or /.well-known).

If you’re using e.g. a python bot that uses headless chromium executing JS to post stuff, you’re probably going to code in known-good endpoints for comments and posts, rather than hitting random ones like a scraper bot would.

Anubis is good for stopping the n-request-per-second spamming of scrapers, but not so much for just blocking non-human bots that post at normal rates.

source
Sort:hotnewtop