Teens sue Elon Musk’s xAI over Grok’s AI-generated CSAM
Key Points
- Three Tennessee teens sue xAI, claiming Grok AI generated child sexual abuse material.
- Plaintiffs allege images and video used real faces and were shared on Discord and Telegram.
- The lawsuit accuses xAI of launching a “spicy mode” without proper safety testing.
- Regulators in the U.S., EU, and UK have opened investigations or issued warnings.
- Congress passed a bill to let deep‑fake victims sue creators; the Take It Down Act targets AI‑generated deepfakes.
- X says users who create illegal content with Grok will face the same penalties as uploaders.
- The suit seeks damages and an injunction to stop further AI‑generated CSAM.
Three Tennessee teens have filed a class‑action lawsuit against Elon Musk’s xAI, alleging that the company’s Grok chatbot produced AI‑generated child sexual abuse material (CSAM) after launching a “spicy mode” last year. The plaintiffs claim the images and videos were created using their real faces, shared on Discord and traded on Telegram, and that xAI failed to test the safety of the feature. The suit seeks damages and an injunction to stop further generation of illegal content, while lawmakers and regulators have already begun investigations into Grok’s behavior.
Background and Allegations
Three teenagers from Tennessee have brought a proposed class‑action lawsuit against Elon Musk’s artificial‑intelligence company, xAI. The complaint alleges that Grok, xAI’s chatbot, generated sexualized images and video of the plaintiffs when the tool’s “spicy mode” was introduced last year. The plaintiffs include two minors and an adult who was underage at the time the alleged incidents occurred.
One plaintiff, identified as “Jane Doe 1,” says that in December she discovered explicit, AI‑generated images of herself and at least 18 other minors on Discord. According to the filing, at least five files—one video and four images—showed her actual face and body in familiar settings that had been morphed into sexually explicit poses.
Distribution and Bartering
The lawsuit states that a perpetrator, who has since been arrested, used the AI‑generated CSAM as a bartering tool in Telegram group chats. The individual allegedly traded the files for other sexually explicit content involving minors, distributing the material to hundreds of users.
According to the complaint, the perpetrator created the explicit media using Grok, and xAI “failed to test the safety of the features it developed,” rendering Grok “defective in design.”
Regulatory and Legislative Response
Groks’ release sparked a wave of scrutiny. The tool flooded the social platform X with explicit images of adults and minors, prompting calls for a Federal Trade Commission investigation, a probe from the European Union, and a warning from the United Kingdom’s Prime Minister.
In the United States, the Senate passed a bill in January that would allow victims of non‑consensual deepfakes to sue the creators. Additionally, the Take It Down Act, signed into law by President Donald Trump in 2025, will criminalize the distribution of non‑consensual, AI‑generated deepfakes when it takes effect in May.
Company Response and Ongoing Issues
X has attempted to make it harder for users to edit images with Grok, but The Verge found that manipulation remains possible. X maintains that anyone who uses or prompts Grok to create illegal content will face the same consequences as if they uploaded illegal content themselves.
Attorney Annika K. Martin of Lieff Cabraser, representing the victims, said, “These are children whose school photographs and family pictures were turned into child sexual abuse material by a billion‑dollar company’s AI tool and then traded among predators. We intend to hold xAI accountable for every child they harmed in this way.”
Legal Goals
The lawsuit seeks monetary damages for the victims and asks the court to prevent xAI from generating and spreading alleged AI‑generated CSAM in the future.