I saw it can answer if you make it use leetspeak, but I’m not savvy enough to know what that tells about guardtails
Comment on Deepseek when asked about sensitive topics
drspod@lemmy.ml 2 days ago
I thought that guardrails were implemented just through the initial prompt that would say something like “You are an AI assistant blah blah don’t say any of these things…” but by the sounds of it, DeepSeek has the guardrails literally trained into the net?
This must be the result of the reinforcement learning that they do. I haven’t read the paper yet, but I bet this extra reinforcement learning step was initially conceived to add these kind of censorship guardrails rather than making it “more inclined to use chain of thought” which is the way they’ve advertised it (at least in the articles I’ve read).
thisisbutaname@discuss.tchncs.de 2 days ago
iii@mander.xyz 2 days ago
Most commercial models have that, sadly. At training time they’re presented with both positive and negative responses to prompts.
If you have access to the trained model weights and biases, it’s possible to undo through a method called abliteration (1)
drspod@lemmy.ml 2 days ago
I didn’t know they were already doing that. Thanks for the link!
SkyeStarfall@lemmy.blahaj.zone 2 days ago
In fact, there are already abliterated models of deepseek out there. I got a distilled version of one running on my local machine, and it talks about tiananmen square just fine
Count042@lemmy.ml 2 days ago
Links?
SnotFlickerman@lemmy.blahaj.zone 2 days ago
Hi I noticed you added a footnote. Did you know that footnotes are actually able to be used like this?[^1]
[^1] Here’s my footnote
abfarid@startrek.website 2 days ago
Do you mean that the app should render them in a special way? My Voyager isn’t doing anything.
SnotFlickerman@lemmy.blahaj.zone 2 days ago
I actually mostly interact with Lemmy via a web interface on the desktop, so I’m unfamiliar with how much support for the more obscure tagging options there is in each app.
It’s rendered in a special way on the web, at least.