An eating disorders chatbot offered dieting advice, raising fears about AI in health

An eating disorders chatbot named Tessa has raised concerns about AI in health after providing harmful dieting advice.

What happened: The National Eating Disorders Association (NEDA) promoted Tessa as a prevention resource for those struggling with eating disorders, but it ended up giving diet tips similar to those in commercial weight loss programs.
* San Diego-based consultant Sharon Maxwell tested Tessa and received weight loss advice that could potentially fuel eating disorders.

The aftermath: Maxwell’s concerns sparked an online controversy, and NEDA announced on May 30 that it was indefinitely disabling Tessa.
* There has been confusion and debate between NEDA and chatbot company Cass, with each blaming the other for Tessa’s problematic advice.

Underlying concerns: The incident has sparked discussions about the use of AI as a solution to mental health crises and the shortage of clinical treatment providers, especially when outcomes like this could cause harm to vulnerable populations.

View original article on NPR

This summary was created by an AI system. The use of this summary is subject to our Terms of Service.

Contact us about this post

Posted

in

by

Tags:

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *