Guarding My Git Forge Against AI Scrapers

⁨18⁩ ⁨likes⁩

Submitted ⁨⁨3⁩ ⁨days⁩ ago⁩ by ⁨tofu@lemmy.nocturnal.garden⁩ to ⁨selfhosting@slrpnk.net⁩

https://vulpinecitrus.info/blog/guarding-git-forge-ai-scrapers/?ref=selfh.st

Didn’t read the full post yet but the introduction on how much load these carpets create was interesting.

Comments

Sort:hotnew top

poVoq@slrpnk.net ⁨3⁩ ⁨days⁩ ago

This is depressing. Profoundly depressing. i look at the statistics board for my reverse-proxy and i never see less than 96.7% of requests classified as bots at any given moment. The web is filled with crap, bots that pretend to be real people to flood you. All of that because i want to have my little corner of the internet where i put my silly little code for other people to see.

From the conclusion, and I feel exactly the same looking at my server logs.

source
keepthepace@slrpnk.net ⁨3⁩ ⁨days⁩ ago
Ads make the web human hostile and such disgraceful behaviors by scrapping bots force to make it bots hostile too.

I am sad and depressed. I went into AI to solve the problems of the world and I still think that the progresses made in machine learning are a huge too to improve the world, but seeing what capitalism turned these tools into… sigh.

I don’t even have the strength anymore to explain that “AI companies” and "AI"are not the same thing…

source