Comment on Wikipedia is giving AI developers its data to fend off bot scrapers
SaltSong@startrek.website 6 days ago
Is this “surrender to avoid being defeated,” or am I misunderstanding the case?
Comment on Wikipedia is giving AI developers its data to fend off bot scrapers
SaltSong@startrek.website 6 days ago
Is this “surrender to avoid being defeated,” or am I misunderstanding the case?
spankmonkey@lemmy.world 6 days ago
The post title is phrased that way, but you can already download wikipedi and the article sounds like they are presenting it in a new way for a new audience.
p03locke@lemmy.dbzer0.com 6 days ago
It’s a common problem. People writing bot scrapers for public data, which costs a lot of bandwidth, when they could have easily just downloaded the entire dataset from a dedicated link. Finding better ways to tell them “Hey, morons, go download the goddamn link!” saves on that bandwidth and web server CPU.