Caelan Conrad did an investigation in this vein. They posed as a suicidal person to see how the AI therapist would talk them out of (or into) it. Some very serious and heavy stuff in the video, be warned. youtu.be/lfEJ4DbjZYg