In a landmark move to combat the nonconsensual exploitation of women and girls online, San Francisco City Attorney David Chiu filed a lawsuit against the proprietors of 16 prominent websites that produce and circulate AI-generated deepfake pornography. As per the announcement, these sites engage in illegal deepfake, revenge porn, and child pornography activities by allowing users to upload clothed pictures and transform them into nude images without consent. The disturbing practice has inflicted severe emotional distress on victims, ranging from celebrities to minors in local schools.
The legal action addresses the ease with which nefarious individuals can manipulate and disseminate AI-created images that bear a troubling likeness to authentic photographs. "This investigation has taken us to the darkest corners of the internet, and I am absolutely horrified for the women and girls who have had to endure this exploitation," Chiu said, stating the gravity of the issue that extends from Taylor Swift to middle school students. In February, an incident where fabricated nude images of 16 eighth-grade students were shared amongst their peers underscored the widespread impact of this technology.
Federal agencies have signaled an increase in extortion cases involving such deepfakes, leaving the victims largely powerless once the images are distributed. The websites involved collectively amassed over 200 million visits in the first half of 2024 alone, with some demanding subscription or payment fees, consequently profiting from the nonconsensual and illicit content. The lawsuit, representing the People of the State of California, aims to not only remove these websites from operation but also seek injunctive relief to prevent the defendants from continuing such illegal activities.
One website brazenly promotes the exploitative nature of their service, proclaiming, "Imagine wasting time taking her out on dates, when you can just use [website] to get her nudes." According to the City Attorney's Office, the lawsuit also aims to secure civil penalties and the costs for bringing the action against the defendants.
Victims of nonconsensual deepfake pornography or those with pertinent information are encouraged to reach out to the City Attorney’s Office through its consumer complaint web portal or via hotline at (415) 554-3977 to assist in the legal proceedings or seek guidance.
