Global Regulators Threaten X Over AI-Generated Explicit Images

· 3 min read ·

European and British regulators are escalating their confrontation with Elon Musk's social media platform X, issuing warnings of severe penalties, including potential bans, over its artificial intelligence (AI) chatbot Grok. The unified concern centers on the tool's alleged use to create and spread non-consensual, sexually explicit "deepfake" images, particularly of women and children.

The controversy stems from reports that users of X's premium subscription service have employed Grok to generate "undressed" or "nudified" images of real people. This process, which uses AI to digitally remove clothing from photographs without consent, has sparked what officials describe as a "horrendous" and "appalling" situation [48716][48232].

In the European Union, the European Commission has formally extended a legal order requiring X to preserve all internal documents and data related to Grok [48716]. Regulators are investigating whether the AI system can generate illegal content, including child sexual abuse material [41987][42160]. An EU spokesperson stated bluntly to X, "It is up to this company to address this. Otherwise, indeed, we will act" [48232]. The bloc is leveraging its Digital Services Act (DSA), which mandates that major online platforms mitigate systemic risks, with non-compliance risking fines of up to 6% of global revenue [48232][42160].

Concurrently, the United Kingdom's media regulator, Ofcom, has launched a formal investigation under the new Online Safety Act [47782][47955]. The probe will determine if X failed in its legal duty to prevent the spread of illegal AI-generated content. British officials, including Prime Minister Rishi Sunak, have stated that "all options are on the table," including a potential effective ban on the platform in the UK—a measure described as the "nuclear option" [45891][48995][49300].

"The platform is now not a 'safe space' for women," stated one online safety expert cited in the investigation [46108]. Despite X restricting Grok to paying subscribers, regulators argue this measure is insufficient to stop the harmful output [46108].

Elon Musk has responded defiantly to some criticisms, accusing detractors of seeking "any excuse for censorship" [46391]. However, the company has not issued a comprehensive public statement addressing the specific regulatory ultimatums. The global pressure highlights a critical challenge with generative AI: its potential for serious abuse despite advanced capabilities, placing responsibility on platforms to implement robust safeguards [41248][49112].

The outcomes of these investigations could set significant precedents for how digital laws are enforced against emerging AI technologies. If found in breach, X faces the prospect of multibillion-dollar fines or being blocked for users in major markets [48496].

Sources