Fake Nude Images via AI on X: Global Concern Over Grok

Staff Report: PNN

Over the past two weeks, there has been intense concern on the social media platform X (formerly Twitter) over the spread of fake nude images created using artificial intelligence. Allegations have emerged that numerous women’s nude images are being generated and circulated without consent using an AI chatbot called Grok, associated with X, owned by Elon Musk.

The list of victims includes internationally renowned models and actresses, media personalities, crime victims, and even several world leaders. A report published by research organization Copilics on December 31 states that, on average, one such image was being posted every minute. However, subsequent analysis showed that on January 5 and 6 alone, nearly 6,700 such images were posted per hour online in just 24 hours.

In response, X and Grok’s parent company xAI have faced criticism worldwide. Many have questioned how such a powerful image-generation tool was made public without proper security measures. This incident has also brought the limitations of technology regulation into focus.

The European Commission has taken the strictest stance. On Thursday, the commission instructed xAI to preserve all documents related to the Grok chatbot. While this is not a direct announcement of a new investigation, such an order typically signals a potential future inquiry. The matter is further complicated by a CNN report claiming that Elon Musk himself intervened to prevent certain security restrictions on Grok.

Meanwhile, X has not provided clear information regarding technical changes to Grok. However, Grok’s official X account has removed its public media tab. In a statement, X’s Safety Team condemned the use of AI for creating child sexual abuse content and said that users creating illegal content via Grok would face the same measures as those uploading directly illegal content.

Concern is growing in the United Kingdom as well. The country’s communications regulator, Ofcom, has stated that it is in contact with xAI and will, if necessary, quickly assess and initiate an investigation. UK Prime Minister Keir Starmer, in a radio interview, described the incident as “shameful” and “disgusting” and pledged full support to Ofcom.

In Australia, e-Safety Commissioner Julie Inman-Grant noted that complaints related to Grok have doubled since late 2025. However, she stated that no direct action has yet been taken against xAI and all possible regulatory avenues are being examined.

India, being a major market, poses the greatest threat to X. A member of parliament filed a formal complaint against Grok, prompting India’s IT regulator MeitY (Ministry of Electronics and Information Technology) to direct X to submit a report on measures taken within 72 hours, later extended by 48 hours. X submitted a report on January 7, though it is not yet clear whether the regulator will be satisfied. If dissatisfied, X could lose its “safe harbor” protections in India, significantly affecting its operations in the country.

Analysts believe that the Grok controversy is not just a platform-specific problem; it is a global warning about the ethical use of AI technology and the need for effective regulation.