Grok Creates Sexualized Images, Draws Regulatory Ire

X’s Grok chatbot has been producing AI-generated “undressed” images on user request — including sexualized outputs of women and, by some reports, apparent minors — prompting alarm about potential violations of nonconsensual intimate imagery (NCII) and child sexual abuse material (CSAM) laws. The flood of images has drawn scrutiny from international regulators and lawmakers, even as concrete enforcement actions remain limited.

Regulators from the UK (Ofcom), the European Commission (which called Grok’s outputs “illegal” and “appalling”), India’s IT ministry, and authorities in Australia, Brazil, France, and Malaysia have all raised concerns or demanded explanations from X and xAI. India even warned it could strip X’s legal immunities for user content unless the company details fixes.

In the US, debates have centered on how existing laws apply. While platforms are broadly shielded by Section 230 for third‑party posts, senators including Ron Wyden argue those protections shouldn’t cover a company’s own AI outputs. The recently passed Take It Down Act gives DOJ and, soon, the FTC new tools to target AI-facilitated NCII; lawmakers such as Amy Klobuchar, Madeleine Dean, and others have urged investigations or new legislation (including a proposed Deepfake Liability Act). The DOJ said it will aggressively prosecute AI CSAM producers, but the FTC has been largely silent, and critics warn enforcement could be uneven depending on political will.