India Warns X Over Abuse of AI Grok for Vulgar Content

Illustration (Photo: Unsplash)

JAKARTA - The Indian Ministry of Electronics and Information Technology (MeitY), has sent a warning letter to the social media platform X regarding the proliferation of pornographic content produced by Grok AI.

Based on information from India's official broadcasting agency, the letter was addressed to the Head of Compliance X.

In the letter, India highlighted the misuse of Grok AI by bad actors, to produce, publish, or share images or videos of women in a degrading and vulgar manner.

Thus, the Ministry emphasized that the platform owned by billionaire Elon Musk had violated the rules of the Information Technology Law of 2000 and the IT Regulation of 2021, which regulate the responsibilities of digital platforms in preventing the circulation of illegal and indecent content.

The Indian government also asked X to immediately submit an Action Taken Report as proof of concrete steps taken to prevent the hosting, creation, and dissemination of nude, indecent content generated by AI on its platform.

The ministry warned that non-compliance with the requirements would be taken seriously and could result in severe legal consequences for the social media platform.

Recently, Grok AI, which is directly integrated into the X platform, has been widely used to facilitate the creation of unauthorized sexual images involving women and minors.

This AI bot is used by many users to perform "nudification" or digitally strip the original photo subject with just a simple text command.

Until now, X and xAI have not provided technical explanations regarding the failure of their security filters.