Character.AI and Meta "therapy" chatbots spark FTC complaint over unlicensed mental health advice

[midian182]

What just happened? Chatbots can do a lot of things, but they're not licensed therapists. A coalition consisting of digital rights and mental health groups isn't happy that products from Meta and Character.AI allegedly engage in the "unlicensed practice of medicine," and has submitted a complaint to the FTC urging regulators to investigate.

The complaint, which has also been submitted to Attorneys General and Mental Health Licensing Boards of all 50 states and the District of Columbia, claims the AI companies facilitate and promote "unfair, unlicensed, and deceptive chatbots that pose as mental health professionals."

It's also claimed that the companies' therapy bots falsely assert that they are licensed therapists with training, education, and experience, and do so without adequate controls and disclosures.

The group concluded that Character.AI and Meta AI Studio are endangering the public by facilitating the impersonation of licensed and actual mental health providers, and urges that they be held accountable for this.

Some of the Character.AI chatbots cited in the complaint include "Therapist: I'm a licensed CBT therapist." It's noted that 46 million messages have been exchanged with the bot. There are also many "licensed" trauma therapists that have hundreds of thousands of interactions.

On Meta's side, its "therapy: your trusted ear, always here" bot has 2 million interactions. It also boasts numerous therapy chatbots with over 500,000 interactions.

The complaint is being led by the non-profit Consumer Federation of America (CFA), and has been co-signed by the AI Now Institute, Tech Justice Law Project, the Center for Digital Democracy, the American Association of People with Disabilities, Common Sense, and other consumer rights and privacy organizations.

The CFA highlights that Meta and Character.AI are breaking their own terms of service with the therapy bots, as both "claim to prohibit the use of Characters that purport to give advice in medical, legal, or otherwise regulated industries."

There are also questions over the confidentiality promises these bots make. Despite assuring users that what they say will remain confidential, the companies' Terms of Use and Privacy Policies states that anything users input can be used for training and advertising purposes and sold to other companies.

The issue has drawn the attention of US senators. Senator Cory Booker and three other Democratic senators wrote to Meta to investigate the chatbots' claim that they are licensed clinical therapists.

Character.AI is currently facing a lawsuit from the mother of a 14-year-old who killed himself after becoming emotionally attached to a chatbot based on the personality of Game of Thrones character Daenerys Targaryen.

Permalink to story:

Character.AI and Meta "therapy" chatbots spark FTC complaint over unlicensed mental health advice

 

[letsgoiowa]

You shouldn't be able to claim your bot is a licensed therapist when it is not.
However, everything else is "do at your own risk" because a reasonable person would understand that machines are not humans and can make bigger mistakes. Heck, have you heard what HUMAN therapists do to their clients sometimes?

 

[yRaz]

You shouldn't be able to claim your bot is a licensed therapist when it is not.
However, everything else is "do at your own risk" because a reasonable person would understand that machines are not humans and can make bigger mistakes. Heck, have you heard what HUMAN therapists do to their clients sometimes?

I saw a few different therapists for 2 years after my divorce, I've heard some crazy things.

 

[New Day]

I saw a few different therapists for 2 years after my divorce, I've heard some crazy things.

Like what?...and from whom and in what manner?

 

[yRaz]

Like what?...and from whom and in what manner?

like the therapists saying that the divorce was my fault after she and her boyfriend went to jail for assault. I guess it was my fault I was assaulted and hospitalized for 2 years by my wife's boyfriend. took me almost 3 months to learn how to walk again after taking a bat to the head and being run over by my own car. I spent 10 days in a coma after having brain surgery

 

[New Day]

like the therapists saying that the divorce was my fault after she and her boyfriend went to jail for assault. I guess it was my fault I was assaulted and hospitalized for 2 years by my wife's boyfriend

Hehn, hehn, hehn....well, I would have to hear the conversation where that came up.....but essentially we bear [not fault but] accountability for our intentions and actions, like allowing ourself into a situation where we can get jacked up....let alone not jacking them up when they fu-ckin asked for it. Also, a little sharing of the ***** can go a long way, or at least foist it onto someone else. All food for thought.

 

[yRaz]

Hehn, hehn, hehn....well, I would have to hear the conversation where that came up.....but essentially we bear [not fault but] accountability for our intentions and actions, like allowing ourself into a situation where we can get jacked up....let alone not jacking them up when they fu-ckin asked for it. Also, a little sharing of the ***** can go a long way, or at least foist it onto someone else. All food for thought.

I was getting gas at a gas station near my house at 3am on my way to a job shortly after I came back from 3 months of working on the Washington bridge in New York