AI Image Abuse Epidemic: 1 in 5 Kids Targeted as Lawsuits and Reforms Battle Deepfake Crisis
A wave of legal action and new data reveals the growing harm of AI-generated sexual content, with a new UNICEF report showing one in five children have faced online sexual abuse, while music giants and victims fight back in court.
The rapid spread of artificial intelligence tools has created a parallel crisis: the mass production of non-consensual sexual images. A new UNICEF report covering 21 countries found that one in five children has experienced tech-facilitated sexual exploitation, with less than 1 percent reporting it to authorities [234231]. This silent crisis is now colliding with legal battles over how AI companies use creative works and personal data.
In a landmark case in Spain, a group of boys used AI apps to create fake nude images of 28 female classmates, paying just nine euros for the service [231224]. The images spread widely on WhatsApp and Telegram, leading to convictions for child pornography and crimes against moral integrity [231224]. The case pushed Spain to reform its penal code and prompted the European Union to agree on banning AI systems that generate sexual deepfakes [231224].
The legal landscape is also shifting around copyright. Sony Music and Warner Records have sued AI company Anthropic, accusing it of running a "brazen campaign" of intellectual property theft [230629]. A separate lawsuit from Sony Music Publishing and Warner Chappell alleges Anthropic fed "tens of thousands" of copyrighted lyrics into its AI models without permission or payment [231733].
Meanwhile, Apple has warned in court filings that when trade secrets are fed into AI systems, the damage may be permanent, arguing that AI "learning" from confidential data creates "irreversible and continually propagating uses" that are "uniquely challenging to undo" [233189].
In Hong Kong, activists say existing laws fail to cover cases where photos are altered or repurposed into stickers, memes, or deepfakes, leaving victims with little legal recourse [233854]. One woman found a stolen nude photo of herself turned into a chat sticker and sent back to her years later [233854].
UNICEF is calling for stronger safety measures on digital platforms and better reporting systems, while victims and their advocates push for legal reforms that keep pace with rapidly evolving technology [234231][234071].