Jakarta - The AI platform is back in the spotlight after the Grok chatbot was almost removed from the App Store by Apple due to the proliferation of pornographic deepfake content without consent.
This case opens up the dark side of the development of generative AI - where technology that is supposed to help is actually used to create illegal content, including those involving unauthorized individuals, even minors.
Apple Drops Hand
According to reports, Apple had rejected the Grok app update and warned its developer, xAI, that the app could be removed if the violation was not immediately corrected.
In its communication, Apple stated that although some of the problems have been addressed on the X platform (formerly Twitter), the Grok app still does not meet content moderation standards.
After a series of revisions, Apple finally approved the app update with the note that its system had been "substantially improved".
Deepfake Content Explosion Causes Chaos
The problem started when the X platform was flooded with pornographic deepfake images created using AI - many of which were without the consent of the subject, even involving underage victims.
This phenomenon was exacerbated after Elon Musk challenged the public to test the limits of Grok's ability, which in fact opened up an exploitation gap.
Even though there are now restrictions, users are still reported to find ways to circumvent the system and still produce prohibited content.
Double Standard?
This case has also sparked criticism of Apple. So far, the company is known to be firm in cracking down on apps that violate the rules - even for minor violations.
In fact, after this incident came to light, Apple immediately removed dozens of other applications that were involved in the creation of similar deepfakes. However, Grok still survived.
This raises the question: do the financial power and influence behind an app influence moderation decisions?
Global Regulatory Pressure Increases
The Grok case reinforces the global push to tighten regulation of AI, particularly with regard to harmful content.
Governments in various countries are beginning to consider stricter rules, including the possibility of independent oversight of Apple's App Review process.
This incident is a stark reminder that AI is not just about innovation, but also responsibility.
When technology can create realistic content in seconds, the line between creativity and breaking the law becomes increasingly thin.
Follow VOI Whatsapp Channel
The English, Chinese, Japanese, Arabic, and French versions are automatically generated by the AI. So there may still be inaccuracies in translating, please always see Indonesian as our main language. (system supported by DigitalSiber.id)
