there was a time when anthropic models would refuse any question related to medicine. not because they care that hard, mind you. it’s because that bloated startup is ran by cultists and they were worried that chatbot will come up with a bioweapon
Comment on This figure illustration from an article on AI sycophancy and human behavior is the epitome of 2026
LibertyLizard@slrpnk.net 1 week ago
Similar related issue. My family has been dealing with some medical issues lately and my mom has been using Claude a lot to explain various complex issues, analyze prognoses, etc. and I’ve noticed that it’s often excessively positive. Like everything that happens is super positive news and a huge step towards recovery.
Now I’m not a medical professional so I don’t know for sure it’s wrong but it sets off my BS alarm for sure.
fullsquare@awful.systems 1 week ago
AcidiclyBasicGlitch@sh.itjust.works 1 week ago
Oh God that actually makes AI sycophancy even more terrifying
Zos_Kia@jlai.lu 1 week ago
On the contrary I’ve used it a bit for benign ouchies and it is very conventional and will always always refer you to an actual doctor.
But it might be another sycophancy aspect, and I wouldn’t be surprised if it went off the rail when you prime it with stuff like “give me a natural holistic ancestral remedy for XYZ”
LibertyLizard@slrpnk.net 1 week ago
Well I wouldn’t say it has discouraged care. Frankly it has been more accurate than I would have expected. It’s more that whenever you give it an update it goes wow that’s fantastic news! But then if you read the actual details it’s not so fantastic lol. So it will maintain this sort of fake positivity even as it accurately explains some of the bad things that could happen.