FILE – Elon Musk listens as President Donald Trump speaks throughout a information convention within the Oval Workplace of the White Home, Could 30, 2025, in Washington.
Evan Vucci/AP
cover caption
toggle caption
Evan Vucci/AP
KUALA LUMPUR, Malaysia — Malaysia and Indonesia have change into the primary nations to dam Grok, the bogus intelligence chatbot developed by Elon Musk’s xAI, after authorities stated it was being misused to generate sexually specific and non-consensual photographs.
The strikes replicate rising world concern over generative AI instruments that may produce reasonable photographs, sound and textual content, whereas present safeguards fail to forestall their abuse. The Grok chatbot, which is accessed via Musk’s social media platform X, has been criticized for producing manipulated photographs, together with depictions of girls in bikinis or sexually specific poses, in addition to photographs involving kids.
Regulators within the two Southeast Asian nations stated present controls weren’t stopping the creation and unfold of faux pornographic content material, notably involving girls and minors. Indonesia’s authorities briefly blocked entry to Grok on Saturday, adopted by Malaysia on Sunday.
“The government sees non-consensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space,” Indonesia’s Communication and Digital Affairs Minister Meutya Hafid stated in an announcement Saturday.
The ministry stated the measure was meant to guard girls, kids and the broader group from pretend pornographic content material generated utilizing AI.
Preliminary findings confirmed that Grok lacks efficient safeguards to cease customers from creating and distributing pornographic content material based mostly on actual images of Indonesian residents, Alexander Sabar, director basic of digital area supervision, stated in a separate assertion. He stated such practices danger violating privateness and picture rights when images are manipulated or shared with out consent, inflicting psychological, social and reputational hurt.
In Kuala Lumpur, the Malaysian Communications and Multimedia Fee ordered a brief restriction on Grok on Sunday after what it stated was “repeated misuse” of the instrument to generate obscene, sexually specific and non-consensual manipulated photographs, together with content material involving girls and minors.
The regulator stated notices issued this month to X Corp. and xAI demanding stronger safeguards drew responses that relied primarily on person reporting mechanisms.
“The restriction is imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing,” it stated, including that entry will stay blocked till efficient safeguards are put in place.
Launched in 2023, Grok is free to make use of on X. Customers can ask it questions on the social media platform and tag posts they’ve instantly created or replies to posts from different customers. Final summer time the corporate added a picture generator characteristic, Grok Think about, that included a so-called “spicy mode” that may generate grownup content material.
The Southeast Asian restrictions come amid mounting scrutiny of Grok elsewhere, together with within the European Union, Britain, India and France. Grok final week restricted picture era and enhancing to paying customers following a worldwide backlash over sexualized deepfakes of individuals, however critics say it didn’t absolutely handle the issue.
