Komdigi Speaks Out on the Abuse of AI Grok in X to Edit Unflattering Photos
JAKARTA - The Ministry of Communication and Digital will follow up on the alleged misuse of Grok AI on the X platform which is used to edit and disseminate obscene content without the consent of the owner.
Director General of Digital Space Supervision, Alexander Sabar, said that the results of the initial search showed that Grok AI did not have explicit and adequate arrangements to prevent the production of photo-based pornographic content.
This condition has the potential to violate privacy rights and the right to one's image, especially when a person's photo is manipulated or disseminated without valid consent.
"This risks causing serious violations of the privacy and right to self-image of citizens," Alexander said in his official statement on Wednesday, January 7.
He assessed that digital manipulation of personal photos is not merely a matter of morality, but a form of usurpation of individuals' control over their visual identity, which can cause psychological, social, and reputational losses.
Alex emphasized that Komdigi is currently coordinating with the Electronic System Operators (PSE) to ensure the availability of effective protection mechanisms.
"Every PSE is obliged to ensure that the technology they provide does not become a means of violating privacy, sexual exploitation, or destroying someone's dignity," he said.
If non-compliance or non-cooperative behavior is found, Komdigi will impose administrative sanctions up to termination of access to Grok AI services and the X platform.
Alex also added that people who are victims of photo manipulation, obscene deepfakes, or violations of the right to self-image can take legal action, including reporting to law enforcement and complaints to Komdigi.
"We appeal to all parties to use the technology of imitation of reason responsibly. The digital space is not a lawless space, there is privacy and the right to self-image of every citizen that must be respected and protected," said Alexander.
Previously, the social media platform owned by billionaire Elon Musk had also been fined Rp80 million to Indonesia, for delays in fulfilling the obligation to moderate pornographic content on its platform.