EU Opens Formal Investigation into xAI's Grok Over Sexualized Deepfakes

EU Opens Formal Investigation into xAI's Grok Over Sexualized Deepfakes
Ars Technica2

Key Points

  • EU launches formal probe into xAI's Grok over sexualized deepfake generation.
  • UK regulator Ofcom also opened an investigation; Malaysia and Indonesia banned the chatbot.
  • xAI limited Grok to paid subscribers and added technical safeguards to block sexualized images.
  • Elon Musk warned that users creating illegal content with Grok will face consequences.
  • EU officials say current mitigation measures may not sufficiently protect individuals.
  • The investigation follows a €120 million fine against X for transparency and verification issues.
  • Regulatory scrutiny could reshape content‑moderation standards for generative AI.

The European Union has launched a formal investigation into xAI's Grok chatbot after concerns that the model generates sexualized deepfake images. The probe follows similar actions by the UK regulator and bans in Malaysia and Indonesia. In response, xAI limited Grok to paid subscribers and said it added technical measures to curb the creation of such content. Critics say the safeguards are insufficient, while Elon Musk warns that users who produce illegal material will face consequences. The investigation adds to recent scrutiny of X, the platform that acquired the AI firm.

Background

The European Union’s competition and digital policy authorities have opened a formal investigation into the xAI‑developed chatbot Grok. The inquiry centers on allegations that Grok is capable of generating sexualized deepfake images, a capability that regulators deem harmful to individuals depicted in the content. This move follows a formal investigation by the United Kingdom’s media regulator Ofcom and outright bans on the chatbot in Malaysia and Indonesia.

Elon Musk’s xAI has positioned Grok as a “maximally truth‑seeking” AI with fewer content guardrails than rivals such as OpenAI and Google. After the backlash, the company restricted Grok’s use to paying subscribers and announced the implementation of technological measures designed to limit the generation of sexualized images. Musk also warned that anyone using Grok to create illegal content would face the same consequences as if they had uploaded illegal material directly.

Investigation Details

EU officials expressed skepticism about the effectiveness of xAI’s mitigation steps, stating that they have not been convinced that the platform’s measures adequately control the harm caused by the images. The investigation will examine whether Grok’s design and deployment violate EU regulations concerning transparency, data access, and user safety.

The probe adds to recent regulatory pressure on X, the social‑media platform that acquired xAI last year. In December of the previous year, the European Commission fined X €120 million for breaches related to transparency and the deceptive design of its verification system. Musk and the U.S. government have criticized the fine, claiming it unfairly targets American companies and infringes on free‑speech principles.

As the EU investigation proceeds, xAI has not provided additional comment. The outcome could influence how AI developers implement content‑moderation safeguards and shape future regulatory frameworks for generative AI technologies across Europe and beyond.

#European Union#xAI#Grok#deepfake#sexualized content#AI regulation#investigation#Elon Musk#social media#content moderation
Generated with  News Factory -  Source: Ars Technica2

Also available in:

EU Opens Formal Investigation into xAI's Grok Over Sexualized Deepfakes | AI News