Comment on Open source project fools AI scrapers with poisoned font
eightys3v3n@lemmy.ca 14 hours agoThough it does change the landscape and introduce additional computation for those scraping.
If they make a mistake and don’t account for all the ways the model can be poisoned they risk significant capital training only to identify an issue causing degraded results.
Imagine if everyone did this differently on many websites. It would cause a re-evaluation of scraping costs.
very rose colored glasses. the extra work to identify such sites is trivial less than even the hashing approach anubis uses.
risks are minimal for data pipelining on the training side. you can bootstrap a classifier that errors towards reject to sweep 99% of the weirdness this thing is doing in a few days.
Yes, rose coloured. But I’d rather be in an environment where there are a million ways to make the life of a scraping AI company hard so it’s impossible for them to account for everything.
More options, are more better especially when they are otherwise meanlessly different for users.
Also there is evidence that poisoning an AI’s training set does not require much data.
Kissaki@beehaw.org 6 hours ago
Ultimately, things like this may well change human behavior through changed LLM behavior.
Human language evolves through use and social context. People use LLMs.
Much like youth speak becoming mainstream, people may eventually use words or formulations inspired by LLM use.