lemmy.world (the normal design) shows the first page without javascript.
The buttons to switch pages don’t work without javascript in the new design, but it still shows more than old.lemmy.world currently does.
old.lemmy.world used to have working page switch buttons without javascript.
MrKaplan@lemmy.world 2 weeks ago
if you set a cookie with the name
jwtit’ll bypass the challenge. this is currently needed due to ddos by criminal ai crawler operatorslemmyartistforhire@lemmy.world 2 weeks ago
Will javascript or this cookie be needed forever now?
MrKaplan@lemmy.world 2 weeks ago
we’ll have to see. when you’re logged in you’ll have that cookie anyway.
due to the structure of the page it’s a very attractive crawler target for those that don’t care about robots.txt and pretend they’re real browsers. they’re hitting it from a range of different countries that even our initial attempts of limiting the challenge to certain countries was not useful.
even after implementing this challenge we’re still getting lots of requests on this domain that all fail the challenge, 42k challenges issued within the last 24h and only 371 (0.89%) solved.
Image
mlmym also doesn’t seem to be that efficient with its api call usage per page load, so it would likely also need some investigation there if that can be optimized to reduce the server load from mlmym pages compared to other clients.
criminal ai crawler operators are killing the (public) js-free web.