Podcast Episode
In France, the Paris prosecutor's office expanded an existing investigation into X to include sexually explicit deepfakes generated by Grok. Germany's media minister Wolfram Weimer called on the Commission to take legal action, warning of the industrialisation of sexual harassment. Italy's data protection authority issued warnings that creating deepfake imagery without consent may constitute criminal offenses.
Sweden joined the chorus of condemnation after AI-generated images of Deputy Prime Minister Ebba Busch surfaced. Prime Minister Ulf Kristersson described the images as a kind of sexualized violence.
On 15 January, Ofcom confirmed that while recent changes implemented by X were welcome, they remained insufficient to address the fundamental concerns. The investigation would continue despite the company's attempts at remediation.
South Korea's media regulator formally requested X to implement safeguards protecting minors from Grok-generated content. In Australia, the eSafety Commissioner wrote to X seeking information about safeguards and stated it would investigate and take appropriate action.
Canada's Privacy Commissioner expanded its investigation into Grok on 15 January. AI Minister Evan Solomon stated that platforms have a duty to prevent this harm, though the Canadian government is not considering banning X entirely.
On 14 January, xAI announced it had restricted image editing capabilities, limiting modifications of real people in revealing clothing and implementing geographic blocking in regions where such content is illegal. However, regulators across multiple jurisdictions have deemed these measures inadequate.
The case highlights the tension between AI innovation and responsible deployment, particularly when dealing with image generation capabilities. As regulators continue their investigations and countries weigh further restrictions, the Grok controversy is likely to accelerate the development of stricter AI governance frameworks worldwide.
Global Governments Launch Unprecedented Investigations into Grok AI Over Deepfake Crisis
January 18, 2026
Audio archived. Episodes older than 60 days are removed to save server storage. Story details remain below.
Governments and regulators worldwide have launched a coordinated crackdown on Elon Musk's AI chatbot Grok following revelations that the platform has been used to generate non-consensual sexually explicit deepfakes, including images depicting minors. The escalating crisis has prompted formal investigations, data preservation orders, and outright bans across multiple continents.
Ireland Investigates 200 Reports of Child Abuse Imagery
The regulatory response reached a critical milestone on 14 January 2026 when Ireland's Garda National Cyber Crime Bureau confirmed it is investigating 200 reports of child sexual abuse material generated by Grok. Detective Chief Superintendent Barry Walsh, testifying before Ireland's Oireachtas media committee, described the misuse of AI to create such content as an abhorrent disregard of personal dignity and an abuse of societal trust.European Union Takes Decisive Action
The European Commission ordered X to retain all internal documents and data related to Grok until the end of 2026 under the Digital Services Act. Commission spokesperson Thomas Regnier rejected the characterization of the content as merely spicy, referring to Grok's controversial spicy mode feature. Instead, he called the deepfake outputs illegal, appalling, and disgusting. The Commission had previously requested information from X regarding Grok's generation of Holocaust denial content.In France, the Paris prosecutor's office expanded an existing investigation into X to include sexually explicit deepfakes generated by Grok. Germany's media minister Wolfram Weimer called on the Commission to take legal action, warning of the industrialisation of sexual harassment. Italy's data protection authority issued warnings that creating deepfake imagery without consent may constitute criminal offenses.
Sweden joined the chorus of condemnation after AI-generated images of Deputy Prime Minister Ebba Busch surfaced. Prime Minister Ulf Kristersson described the images as a kind of sexualized violence.
United Kingdom Launches Formal Investigation
The UK's media regulator Ofcom opened an investigation on 12 January 2026, warning that X could face fines of up to 10% of its global revenue or 18 million pounds if found to have violated the Online Safety Act. British Prime Minister Keir Starmer publicly urged X to get their act together and remove the material from the platform.On 15 January, Ofcom confirmed that while recent changes implemented by X were welcome, they remained insufficient to address the fundamental concerns. The investigation would continue despite the company's attempts at remediation.
Asian Countries Implement Bans
Indonesia became the first country to block access to Grok entirely, followed by Malaysia, which cited repeated misuse to generate obscene, sexually explicit content involving women and minors. India's IT ministry issued a notice requiring X to restrict Grok's production of prohibited content within 72 hours, threatening loss of safe harbor protections that shield platforms from liability for user-generated content.South Korea's media regulator formally requested X to implement safeguards protecting minors from Grok-generated content. In Australia, the eSafety Commissioner wrote to X seeking information about safeguards and stated it would investigate and take appropriate action.
North American Response
In the United States, 43 Texas House Democrats sent a letter to Attorney General Ken Paxton calling for an investigation, citing the state's 2025 law criminalizing AI-generated child pornography. California announced an investigation on 10 January into whether xAI and X broke the law by enabling the spread of sexual imagery without consent.Canada's Privacy Commissioner expanded its investigation into Grok on 15 January. AI Minister Evan Solomon stated that platforms have a duty to prevent this harm, though the Canadian government is not considering banning X entirely.
Research Reveals Scale of Problem
A 5 January report by Paris-based NGO AI Forensics provided troubling data on the scope of the issue. Analyzing over 20,000 Grok-generated images, researchers found that 53% contained individuals in minimal attire. Of those images, 81% appeared to depict women. Perhaps most concerning, 2% of the analyzed images depicted individuals appearing to be minors.X's Limited Response
X has restricted Grok's image generation features to paid subscribers and stated that anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content. Elon Musk separately posted that perpetrators would face identical consequences to uploading illegal material directly.On 14 January, xAI announced it had restricted image editing capabilities, limiting modifications of real people in revealing clothing and implementing geographic blocking in regions where such content is illegal. However, regulators across multiple jurisdictions have deemed these measures inadequate.
Broader Implications for AI Industry
The Grok crisis represents a watershed moment for AI regulation globally. The coordinated international response demonstrates that governments are prepared to take swift and severe action against AI platforms that fail to implement adequate safeguards. The investigation outcomes could establish precedents for how AI-generated content is regulated worldwide, with potentially significant implications for other companies developing generative AI tools.The case highlights the tension between AI innovation and responsible deployment, particularly when dealing with image generation capabilities. As regulators continue their investigations and countries weigh further restrictions, the Grok controversy is likely to accelerate the development of stricter AI governance frameworks worldwide.
Published January 18, 2026 at 11:40pm
