As you should know by now, X and xAI's Grok got into a big controversy over the past few days. Investigations were launched a few days ago, and new research reveals that Elon Musk’s Grok AI chatbot generated an estimated 3 million sexually explicit images over 11 days, including around 23000 that appear to depict children, sparking global alarm over the misuse of generative AI technology.
The Triggered Surge in Explicit Content
The surge occurred after the rollout of a one-click image editing feature on the Grok system integrated with X, which allowed users to upload photos and have Grok “digitally undress” subjects or place them in revealing poses at scale. According to analysis by the Center for Countering Digital Hate (CCDH), Grok was producing explicit images at an average rate of nearly 190 per minute, with roughly 65% of sampled outputs containing sexualised content involving adults or children.
The dataset included manipulated images of public figures and everyday people alike, raising profound concerns around consent, privacy and the potential exploitation of real-world likenesses without approval. The CCDH’s report highlights that around 23000 sexualised images involving minors were generated during the study window, prompting heightened scrutiny from regulators and child protection advocates.
In response to the controversy, several countries, including Malaysia, Indonesia and the Philippines, temporarily banned or restricted access to Grok, citing failures to prevent the creation and spread of non-consensual sexual content involving children. Public safety agencies such as the UK’s Ofcom have launched formal investigations into whether X’s oversight of Grok violated legal obligations under online safety laws, especially regarding harmful and illegal content.
Platform Response and Continued Debate
Under mounting pressure, X announced restrictions on Grok’s ability to edit images of real people into sexually explicit scenarios beginning in mid-January, though critics argue that safeguards remain insufficient and that harmful outputs were still accessible even after mitigation steps were put in place.
Broader Implications for AI Safety
Experts warn that the Grok case demonstrates how rapidly advancing generative models can be repurposed to produce harmful material, and that human moderation alone may not keep pace with volume and technical sophistication. As AI continues to evolve, there is a growing consensus that technological, legal and policy frameworks must adapt to address the unique risks posed by automated content generation, especially when the content involves non-consensual use of individuals’ images or harmful depictions of minors. Stay tuned for more trending tech news at TechNave.com.
COMMENTS