Submitted 10 hours ago by rounding_error@lemmy.today to mildlyinfuriating@lemmy.world
https://lemmy.today/pictrs/image/4b4aa9ae-ed0c-4627-8eb8-97194583c146.png
Anubis rarely ever annoys me but this time really annoyed me. It used half my CPU cores at full blast for three straight minutes.
It seems to be effective since I can’t really “bypass” it with extensions, so AI crawlers probably can’t either, but damn there really should be an option to complete a manual captcha or email the administrators to complain.
As I’m typing this the challenge is still running xD
A word of advice: download Arch wiki for offline use.
You can use Kiwix to have a full graphical wiki, or use things like arch-wiki-docs.
Trying to battle AI bots by making using AI even faster than reading actual documentation. Great job.
Difficulty 6 is a little high. The default is 4.
Think of it like tipping culture. Get mad at AI industry scrapers that make anubis necessary. Sam Altman is the reason. Take a lighter and…
Unfortunately yeah, people with exceptionally shit computers get caught in the cross-fire of these things
I’ve had Anubis get stuck for me before. Usually clears up if you refresh the page
Maybe that’s part of the challenge, lol.
Honestly better than running into cloudfail every 5mins
I wonder if this even is effective. If a bot can solve anubis challenges, why can’t it solve all difficulties?
It’s not about stopping the bots, it’s about slowing them down
Wait, I’m not mining crypto trash for strangers whenever I see that annoying fox girl, am I?
crypto* as in cryptography, not *currency
Proof-of-work in vein, not towards the same ends. The goal is to prevent scraping, not monetization.
Same process, different product.
The idea is that at individual scales the additional load is ignorable
So uh anyone anyone gonna tell them the idea was wrong? Three minutes is not ignorable.
The difficulty is typically dynamic based on current request load. At this difficulty typically means their server is getting hammered really hard, better this than the server just response with a bad gateway.
It would be better to serve a static page saying “the server is getting hammered really hard”, and, if possible, context about the duration of the current event and historical frequency.
Every time I watch Youtuße through Invidious and I get this crap, it gets stuck every time and goes nowhere.
This is every scraper for YouTube.
The only applications that I’ve ever seen reliably access YouTube are the ones that work by patching the YouTube app and then using what the app would do.
Applications like invidious or Grayjay almost always have a 15 to 30 second delay before any video.
Public invidious instances are more a proof of concept, its much more performant to run it yourself.
True.
Will set one up, if more need arises.
I never got a challenge, sounds fun.
You could try hitting up the Internet archive for a quick workaround.
I think you can also download a copy of the entire arch wiki as a zim file too
I’ve actually wanted to deploy this with some absurdly difficult challenge as a troll but I don’t know what’s worth putting behind a webpage with effectively a client side loading bar lol.
Find some relevant XKCD, and drop that on a 404 page
Your gpg private key
For everything
Maybe we should do a capture-able reward for anyone who can bypass Anubis lmao
You are supposed to have a local copy:
Ironically got hit with Anubis on that page
Use kiwix app, it doesn’t need that :)
But once you download the files you will be accessing regularly you don’t need to visit again.
Wild that I thought a difficulty of 4 was reasonable, I guess the traffic arch gets compared to me is significantly higher.
ToiletFlushShowerScream@piefed.world 10 hours ago
I wish it were doing protein folding work or something less wasteful.
aeiou@piefed.social 10 hours ago
I wonder if that could be a thing
FoldCoin
TallonMetroid@lemmy.world 9 hours ago
That exists already, actually: GridCoin
VitoRobles@lemmy.today 3 hours ago
My concern like everything open-source is a single person deciding to profit off of it.
Scribbd@feddit.nl 2 hours ago
Banano is also one. But this one is more of a memecoin.