Submitted 2 days ago by Armand1@lemmy.world to unitedkingdom@feddit.uk
https://www.independent.co.uk/news/uk/home-news/ai-chatbot-patients-diagnosis-gp-b3063668.html
The study found that AI’s suggested diagnoses matched the eventual confirmed diagnosis in more than half of cases
So it got it wrong half the time?
However, one conversation was later rated “somewhat harmful” by a doctors after the chatbot listed a possible cancer diagnosis which caused the patient anxiety.
In another conversation, the chatbot hallucinated, and clinical information was added in five interactions.
This ain’t it, chief.
Who paid for that study?
Well, this seems to be the study.
Google’s AI is front and center and theh were credited. Not sure if they funded it too.
It is funded by Alphabet, yea I’m not gonna trust this one 😅
Every single study like this needs a control group of “Oregon Trail generation” who actually know how to find information online, getting 15 minutes on WebMD.
I’m guessing they’d get the same results, especially since the AI even pulled out the WebMD classic:
However, one conversation was later rated “somewhat harmful” by a doctors after the chatbot listed a possible cancer diagnosis which caused the patient anxiety.
Because that’s all the chatbot is doing, regurgitating WebMD
Wimopy@feddit.uk 2 days ago
I mean I know doctors make mistakes too, but 75% if you get 3 guesses seems quite lacking. Especially if you then need to confirm with a doctor anyway.
And yeah, the hallucination part is insane and surely unacceptable.
Not to mention I’d need to read the study but I wonder what the cases and symptoms were, and if doctors ended up agreeing with the top 3 due to having read the transcripts beforehand. And we also know even experts can be fooled into thinking someone else is an expert if they talk well (see: Dr Fox effect, and related studies).