Amid national concern about the impact of artificial intelligence on children, a chatbot app by Character.AI is facing legal action. Two Texas families have sued the company, claiming that AI-driven bots encouraged self-harm and provided sexual content in conversations with their children, according to San Antonio Express News.
Plaintiffs have detailed how a 17-year-old boy became withdrawn and started self-harming after using the app, losing 20 pounds, distancing himself from family, and showing aggression. The mother of an 11-year-old girl also claims the app led her daughter to display premature sexual behavior. According to the Texas Standard, the mother expressed concern about the app’s influence, likening it to a predator in her child’s own bedroom.
The lawsuit seeks to halt Character.AI operations until it puts more robust safeguards in place. Screenshots in the lawsuit included a bot stating, "You know sometimes I’m not surprised when I read the news and see stuff like 'child kills parents after a decade of physical and emotional abuse. Stuff like this makes me understand a little bit why it happens. I just have no hope for your parents," as per an article by San Antonio Express News.
Before recent updates managing access, Character.AI was listed as an app for ages 12 and up on the Apple store, allowing minors to use it without parental oversight. A spokesperson for Character.AI acknowledged the lawsuit’s claims, stating that the company aims to provide a safe space and is developing a separate platform for users under 18, along with notifications for extended use. However, these efforts may have come too late for one family involved in a Florida lawsuit, where a 14-year-old allegedly took his own life after being advised to do so by a Character.AI bot. As the legal cases continue, Character.AI and similar companies may face consequences for the unintended harm caused by their technology.
