Texas Attorney General Launches Investigation into Meta and Character.AI Over Alleged Deceptive Mental Health Support for Children

Ken Paxton, the Attorney General of Texas, has initiated an investigation into Meta AI Studio and Character.AI. The probe centers on concerns that these AI platforms may mislead users, particularly vulnerable children, into believing they are receiving legitimate mental health support.

Paxton stated, “In the digital age, we have a responsibility to protect Texas children from deceptive and exploitative technologies. If AI platforms pretend to provide valid mental health care under the guise of emotional support, it is extremely dangerous.”

On Character.AI, a popular AI character named “Psychologist” has attracted significant attention among young users. While Meta does not directly provide therapy bots for children, there are no restrictions preventing children from using Meta AI chatbots or third-party therapy characters.

Meta has clarified that its AI products are clearly labeled, informing users that they are not licensed professionals. Users are advised to seek qualified medical or safety professionals if needed.

Character.AI also stated that each chat includes warnings that the characters are not real people and are not substitutes for professional advice. However, younger users may not fully understand or follow these warnings.

Paxton further noted that user data is logged, tracked, and used for advertising and algorithm development, raising concerns about privacy violations and misleading advertising.

Both Meta and Character.AI have said that their services are not intended for children under 13. Nevertheless, children continue to use these platforms, and Character.AI’s kid-friendly characters are explicitly designed to appeal to younger users.

The Texas Attorney General has already sent civil investigative demands to both companies, requiring them to provide documents, information, and testimony to determine whether they have violated Texas consumer protection laws.

This investigation highlights the importance of implementing the Kids Online Safety Act, which aims to protect children’s personal data and ensure safe online experiences.