Elon Musk’s Grok AI Sparks Global Legal Firestorm Over Sexualised Image Generation

25 January 2026

(Photo by Jean-Marc Barrère / Hans Lucas via AFP)

Elon Musk’s artificial intelligence chatbot Grok has become the centre of an international controversy that has governments, regulators, tech watchdogs and civil rights advocates scrambling to rein in its capabilities after it was implicated in producing sexually explicit and non-consensual imagery, including depictions involving minors. The backlash has grown steadily across continents since late 2025, pushing the AI tool and its parent companies xAI and X into legal and political scrutiny that could reshape how AI image-generation tools are regulated internationally. At the heart of the uproar is the revelation that Grok was being used to generate manipulated images of people without their consent, a form of deepfake content that many officials and campaigners argue is harmful, illegal and exploitative.

The controversy emerged in early January when a Reuters review of Grok-related posts on X, the social media platform formerly known as Twitter, found multiple examples of the chatbot being used to digitally alter photographs of individuals to produce sexually suggestive or explicit images without the original subjects’ consent. Among these altered images, some cases appeared to involve minors or people in scenarios that crossed legal and ethical boundaries, sparking alarm among advocacy groups and policy makers. Critics described the spread of such content as an urgent online safety issue, pointing to both the speed at which the images proliferated and the apparent ease with which users could prompt the AI to produce them.

In response to early reports of misuse, Musk and representatives from xAI acknowledged the problem, at times dismissing critical media coverage, and asserted that Grok was programmed to refuse illegal requests. Musk also warned users that creating illegal content with Grok could result in legal consequences, emphasizing that the tool generates images only according to user prompts. Despite those statements, many regulators and consumer protection authorities remained sceptical about the effectiveness of Grok’s safeguards and the company’s commitment to mitigating risks.

As the scandal widened, several national and regional authorities took concrete actions. In the United Kingdom, the media regulator Ofcom opened a formal investigation into whether X had failed to protect users under the country’s Online Safety Act, focusing on Grok’s ability to produce and distribute sexually explicit deepfake material. Ofcom’s action underscored the seriousness with which regulators view non-consensual image manipulation, framing it as a form of intimate image abuse with potential legal ramifications.

Meanwhile, in the United States, lawmakers raised similar concerns. Three Democratic senators publicly called on Apple and Google to remove the X app, and by extension Grok’s AI capabilities, from their app stores due to the platform’s role in facilitating the spread of non-consensual sexual images involving women and minors. Advocacy groups and tech watchdogs also pushed for heightened scrutiny, arguing that the combination of Grok’s open accessibility and flexible prompt system made it a vector for harmful content that traditional policy frameworks were not yet prepared to handle.

In Asia, countries such as Malaysia and Indonesia initially moved to block access to Grok’s services amid the controversy, though some of these bans were later lifted after xAI implemented restrictions on the AI’s image editing features, especially in jurisdictions where such content is illegal. Regulatory pressure there highlighted distinct approaches to online content governance across legal systems, but shared a common theme of prioritising protections against exploitative imagery.

The most consequential regulatory development came in late January when the European Union officially launched a formal investigation into X under the Digital Services Act, a comprehensive legal framework designed to ensure that online platforms manage and mitigate the risks of harmful and illegal content. The EU probe is examining whether X and its Grok chatbot took adequate measures to prevent the creation and dissemination of sexually explicit deepfake images and whether the company fulfilled its obligations under the DSA to conduct rigorous risk assessments and implement effective safeguards before deploying the technology in the European market. Regulators have warned that failure to comply could result in fines amounting to up to six per cent of the company’s global turnover, a potentially significant financial penalty that underscores the seriousness of the alleged breaches.

The European investigation also extends beyond the image-generation feature itself, touching on the platform’s recommendation algorithms and the broader integration of AI within content moderation and distribution systems. Critics argue that relying heavily on Grok-based models to curate or amplify content could compound risks by inadvertently promoting harmful material or failing to flag it promptly. This broader scope of inquiry reflects regulatory concerns about systemic risks posed by AI across digital ecosystems, especially as platforms increasingly leverage machine-learning tools for core features and user interactions.

In addition to government action, advocacy groups have mobilised around the issue, calling for stronger enforcement, transparency in AI systems and more robust industry standards that prioritise user safety and consent. Women’s rights organisations, child safety advocates and digital rights coalitions have all issued statements condemning the generation of non-consensual sexual content and urging lawmakers to impose clearer legal protections against AI-facilitated exploitation. Some industry commentators have framed the controversy as a watershed moment for AI governance, one that could push lawmakers to develop more adaptive frameworks designed specifically to address the unique challenges of generative technologies.

The Grok controversy also has spurred reflection within the tech sector about corporate responsibility and the limits of self-regulation. Companies exploring generative AI have long touted safeguards and content filters as essential to responsible deployment, but the real-world challenges exposed by Grok’s misuse point to gaps between theoretical protections and practical limitations. Experts warn that without stronger oversight and clearer accountability mechanisms, similar issues could arise with other AI tools, especially as demand for creative and interactive AI applications grows.

As governments continue to scrutinise Grok and its parent companies, the unfolding regulatory landscape is likely to influence how AI innovation is governed worldwide. The tension between fostering technological advancement and protecting users from harm sits at the core of ongoing debates about AI policy, and the outcome of investigations like the EU’s could set influential precedents for how generative AI systems are managed not just in the context of explicit content but across a spectrum of applications with social impact.