Malaysia and Indonesia have taken a decisive step by restricting access to Grok, the AI chatbot associated with Elon Musk’s social media platform, X. The move responds to serious concerns that the tool is being exploited to generate sexually explicit fake images of real people without their consent. Grok allows users to create and manipulate images, but authorities are alarmed by its growing misuse to produce revealing or sexualized content.

Regulators have highlighted the risks to women and children, warning that Grok could easily be used to create pornographic deepfakes. By blocking the chatbot entirely, Malaysia and Indonesia are the first countries worldwide to adopt such a stringent stance against an AI tool, reflecting concerns that these technologies are advancing faster than existing safety regulations can manage.

The issue extends beyond this single chatbot to broader online safety concerns. In Malaysia, communications regulators had previously warned X about potential misuse, but felt the company relied too heavily on user reporting rather than proactively preventing harmful content. Indonesia’s digital affairs ministry emphasized the importance of dignity and human rights, stating that AI-generated sexual content erodes public trust and endangers vulnerable populations. The government has formally requested explanations from X regarding Grok’s moderation and control. The ban aligns with Indonesia’s history of restricting online adult content, including platforms like Pornhub and OnlyFans, viewing AI-generated sexual images as an advanced extension of the same problem.

The controversy is drawing global attention. In the UK, regulators are reviewing X’s compliance with online safety standards, while political leaders worldwide have condemned the creation of fake explicit images. For those whose images have been manipulated by Grok, reporting attempts have often failed, sometimes worsening the situation and amplifying harm.

This backlash is pushing X to rethink Grok’s operational framework, as governments increasingly treat advanced AI tools as regulated products requiring accountability and robust moderation, rather than experimental features.