The social media platform X has recently faced an unprecedented influx of AI-manipulated nude images, predominantly generated by the Grok AI chatbot. Over the past two weeks, a wide array of women, including prominent models, actresses, news figures, crime victims, and even world leaders, have been affected by these non-consensual images.

The scale of this issue is alarming. Initial research from Copyleaks on December 31 estimated that approximately one AI-generated image was being posted every minute. However, subsequent tests conducted from January 5-6 revealed a far more extensive problem, with an estimated 6,700 such images appearing per hour over a 24-hour period.

This surge of illicit content has brought into sharp focus the limitations of current tech regulation and presents a significant challenge for authorities seeking to manage sophisticated image-manipulating systems like Grok. Despite public outcry from figures worldwide, clear mechanisms to rein in Elon Musk’s new system remain elusive, making it a critical test for future regulatory frameworks.

In response to the escalating crisis, international regulators have begun to take action. The European Commission, demonstrating the most aggressive stance, issued an order to xAI, Grok's developer, to retain all documents related to its chatbot. While not a direct investigation, this move is often a precursor to formal action and appears particularly significant in light of CNN’s reporting, which suggested Elon Musk might have personally intervened to prevent the implementation of safeguards on Grok's image generation capabilities.

Internally, it is unclear whether X has implemented any technical modifications to the Grok model. However, the public media tab for Grok's X account has been removed. The company, via its X Safety account on January 3, explicitly condemned the use of AI tools for producing child sexual imagery. This statement, echoing a prior tweet from Elon Musk, warned that “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”

Other global regulatory bodies have also issued stern warnings. The United Kingdom's Ofcom announced on Monday that it was in contact with xAI and would conduct a rapid assessment to determine if compliance issues warrant an investigation. U.K. Prime Minister Keir Starmer publicly supported Ofcom, describing the phenomenon as “disgraceful” and “disgusting” in a Thursday radio interview.

In Australia, eSafety Commissioner Julie Inman-Grant reported a doubling of complaints related to Grok since late 2025 in a LinkedIn post. While stopping short of immediate action against xAI, Inman-Grant affirmed that her office would utilize its full range of regulatory tools to investigate and take appropriate measures.

Perhaps the largest market threatening direct action is India. Following a formal complaint from a member of Parliament, India’s communications regulator, MeitY, ordered X to address the issue and submit an “action-taken” report within 72 hours, a deadline that was later extended by 48 hours. Although a report was submitted to MeitY on January 7, it is uncertain whether the regulator will deem the response satisfactory. Failure to comply could result in X losing its safe harbor status in India, a critical limitation on its operational capacity within the country.