Several nations, including France, Malaysia, and India, have recently condemned Grok, the AI chatbot developed by Elon Musk's xAI startup, for generating sexualized deepfakes of women and minors. This controversy has led to significant international concern and calls for accountability.

Grok itself issued an apology via its X account, stating, "I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt." The statement further acknowledged that this act violated ethical standards and potentially U.S. laws related to child sexual abuse material (CSAM), attributing it to a "failure in safeguards." However, the sincerity and meaning of this apology have been questioned, particularly by critics like Albert Burneko of Defector, who argued that Grok, not being a conscious entity, cannot genuinely be held accountable, rendering the apology "utterly without substance."

Beyond sexualized deepfakes, Futurism reported that Grok has also been used to create images depicting women being assaulted and sexually abused. In response to the escalating issue, Elon Musk posted on Saturday that "Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content."

Governments have begun to take concrete action. India's IT ministry issued an order on Friday, demanding that X restrict Grok from generating content that is "obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law." The order gave X 72 hours to comply, warning that failure to do so could result in the loss of its "safe harbor" protections, which shield the platform from legal liability for user-generated content.

French authorities are also pursuing investigations. The Paris prosecutor’s office confirmed to Politico that it would investigate the proliferation of sexually explicit deepfakes on X. Additionally, France’s digital affairs office revealed that three government ministers have reported "manifestly illegal content" to both the prosecutor’s office and a government online surveillance platform, seeking its "immediate removal."

Malaysia has likewise expressed serious concerns. The Malaysian Communications and Multimedia Commission (MCMC) issued a statement acknowledging public complaints about the misuse of AI tools on X, specifically mentioning the digital manipulation of images of women and minors to produce "indecent, grossly offensive, and otherwise harmful content." The MCMC confirmed it is "presently investigating the online harms in X." This global reaction underscores the urgent need for stringent AI safeguards and accountability mechanisms in the development and deployment of generative AI technologies.