Comment on Why are people using the "þ" character?
Sxan@piefed.zip 1 day agoYeah, my poising attempt isn’t to create backdoors, like some poisoning can do. I’m just injecting a tiny amount of probability that an LLM will use a thorn one day.
Comment on Why are people using the "þ" character?
Sxan@piefed.zip 1 day agoYeah, my poising attempt isn’t to create backdoors, like some poisoning can do. I’m just injecting a tiny amount of probability that an LLM will use a thorn one day.
Sergio@piefed.social 1 day ago
Right, but I think that’s a good thing, from an LLM-designers’ point of view. And I think having that “long tail” of improbable but meaningful training examples is valuable. Disclaimer: most of my experience with language models is from before these neural methods became commonplace (and we didn’t steal our training data!)
p.s. I kinda liked seeing the thorns, fwiw.