Syamsu Rizal, a member of the House of Representatives' Commission I, urged the Ministry of Communication and Digital Affairs to consider blocking the platform if it fails to implement stricter moderation and privacy protections for the AI tool.
"We have seen Grok AI on platform X being exploited by users to transform photos into obscene content," Rizal said here on Thursday.
"With specific prompts, the AI can be instructed to produce such material. This is clearly dangerous."
The controversy comes amid heightened global scrutiny over generative AI tools and their potential to create "deepfake" pornography.
Related news: Ministry probes alleged misuse of Grok AI for immoral content
Rizal emphasized that the government has a duty to protect citizens from digital exploitation.
He stated that if X fails to implement adequate content moderation safeguards to prevent the production and distribution of such material, the ministry must act firmly by blocking access to the platform in Indonesia.
The warning follows an ongoing investigation by the Ministry of Communication and Digital Affairs into the misuse of Grok AI features.
The ministry’s initial findings suggest the AI lacks sufficient filters to prevent users from altering personal photos of Indonesian citizens without their consent.
Director General of Digital Space Oversight at the ministry Alexander Sabar confirmed Wednesday that preliminary evidence indicates a lack of specific safeguards.
"This poses a serious risk of violating privacy and image rights," Sabar said, noting that such practices risk violating Indonesian laws regarding digital consent and pornography.
Related news: Prabowo warns youth of AI manipulation, cites fake videos of himself
Translator: Bagus Ahmad Rizaldi, Aditya Eko Sigit Wicaksono
Editor: Rahmad Nasution
Copyright © ANTARA 2026
