Building safer artificial intelligence mental health chatbots

A new paper in the Journal of the American Medical Informatics Association proposes a framework for making AI mental health chatbots safer, calling for transparency, standardized evaluation, and ongoing oversight across the chatbot lifecycle. The authors argue that all AI mental health tools should be tested on benchmarks covering crisis recognition, sycophancy, and hallucination, and accompanied by public model cards to reduce the risk of harm.