Apple reportedly considered removing the Grok AI chatbot from the App Store after the app was found to be generating sexualised deepfake images, including non-consensual content. The move came amid mounting pressure on Apple to act, as the company faced criticism for continuing to host the app despite widespread misuse. According to reports, Apple ultimately chose to intervene behind the scenes rather than immediately enforce a ban.
Behind-the-Scenes Intervention Instead of Immediate Ban
The controversy centres around Grok, developed by xAI and integrated with the social platform X. Earlier this year, the tool went viral for its ability to generate manipulated images that appeared to “undress” individuals without consent.
In response, Apple reportedly determined that both Grok and X had violated App Store guidelines and privately warned developers that the app could be removed if corrective actions were not taken. Instead of pulling the app outright, Apple required the developers to submit a plan to improve content moderation and address the spread of harmful content.
Deepfake Scandal Triggers Global Backlash
The issue is part of a broader controversy surrounding Grok’s misuse. Reports indicate that users were generating large volumes of explicit AI images, including content involving women and even minors, raising serious legal and ethical concerns.
The backlash quickly escalated beyond Apple. Lawmakers, advocacy groups, and regulators worldwide began scrutinising the platform, with some calling for Grok and X to be removed from app stores entirely. In some regions, authorities even explored bans or launched investigations into whether the technology violated laws related to child safety and online harm.
A Turning Point for AI Regulation
The controversy surrounding Grok could mark a turning point in how AI apps are regulated on major platforms. With increasing scrutiny from governments and advocacy groups, tech companies may be forced to adopt stricter moderation systems and clearer accountability measures for AI-generated content. Stay tuned for more trending tech news at TechNave.com.
COMMENTS