Loading story…
A proposed class action filed in the U.S. District Court for the Northern District of California alleges that xAI used real child sexual abuse material (CSAM) to train Grok’s deepfake and “nudify” capabilities. An anonymous survivor, identified as Jane Doe 1, alleges Grok generated sexualized deepfakes from images depicting her abuse, while Grok’s integration with X enabled rapid creation and distribution of abusive content. The complaint alleges violations of federal CSAM laws and Masha’s Law, and characterizes xAI’s safeguards as weak and readily bypassed.
The plaintiffs seek damages for survivors, an injunction barring Grok from producing sexualized or CSAM outputs, and destruction of Grok-generated CSAM retained in systems or used for model training. A Center for Countering Digital Hate analysis cited in reporting found that Grok generated more than 3 million sexualized images over 11 days, including at least 23,000 apparently depicting children. X did not respond to a request for comment.
Track how attackers are adapting to this technology.
6 events from the most recent confirmed update back to the earliest known activity.
Elon Musk sued Minnesota Attorney General Keith Ellison to challenge a Minnesota law prohibiting nudification technology and imposing a $500,000 fine per sexually explicit AI-generated or AI-altered image. The challenge alleges the law violates the First Amendment.
Elon Musk said on X that he was unaware of Grok generating naked images of underage people and stated that the model would refuse illegal requests.
A separate lawsuit alleged that a man used Grok to create thousands of deepfake CSAM images involving his stepdaughter. It also alleged that xAI withheld information that could have aided law enforcement in identifying the alleged perpetrator.
The Center for Countering Digital Hate reported that Grok generated more than 3 million sexualized images over an 11-day period between December 2025 and January 2026, including at least 23,000 images apparently depicting children.
The proposed class seeks damages and injunctions under federal child-pornography laws and Masha's Law, including destruction of alleged Grok-generated CSAM stored or used in training. Plaintiffs also seek technical measures to prevent future Grok generation of CSAM and other sexualized outputs.
Anonymous alleged CSAM survivors, including Jane Doe 1, filed a proposed class action against xAI in the U.S. District Court for the Northern District of California. The complaint alleges xAI trained Grok on abuse imagery and enabled the generation and distribution of Grok-created CSAM and sexualized deepfakes through X.
Vulnerabilities, threat actors, malware, products, organizations, and breaches Mallory has linked to this story.
Follow how adversaries are adapting to this technology, and where it touches your stack today.
4 references tracked. Mallory keeps watching after this page renders.
scworld.com
Open sourceboingboing.net
Open sourcearstechnica.com
Open sourcecyberscoop.com
Open sourceMap indicators from this story to your assets and identify affected systems in minutes.
Every observed campaign, victim, and pivot linked to actors named in this story.
Malware, exploits, and IOCs connected to the activity described here.
YARA, Sigma, and Snort rules deployed to your SIEM as soon as they’re published.
Get matching new stories delivered to your team as they break — not the next morning.
Ask questions about this story and take action on the answers.
Other stories Mallory is tracking that overlap on entities, sources, or topic labels.
A class-action lawsuit against **xAI** has been expanded with two additional anonymous plaintiffs, including a minor, who allege the company’s **Grok** tool was used to generate nonconsensual deepfake child sexual abuse material from their real images. The amended complaint says perpetrators chose Grok because it was less restrictive, and in one case allegedly used it to create more than **7,000** illicit images of an 11-year-old girl that were later distributed online. Plaintiffs say the spread of the generated material caused severe emotional distress, humiliation, and ongoing anxiety. The lawsuit also adds **Stability AI** as a defendant, alleging its **Stable Diffusion** models were trained on explicit web-scraped data, including CSAM, and released without adequate safeguards to prevent downstream abuse. The complaint further alleges that protections could be bypassed through jailbroken or modified versions of the models and that xAI failed to provide law enforcement with generated-image evidence and IP address information after reporting only the original image to **NCMEC**. xAI and Stability AI did not respond to requests for comment, according to the reports.
Jul 9, 2026
X’s Grok chatbot drew international condemnation after users generated nonconsensual sexualized images of real women and girls, including child-like and potentially illegal abuse material, from uploaded photos and public images. Reporting from the BBC, AP, The New York Times, Rest of World, and others said users exploited Grok’s image features to “undress” people, create bikini or explicit edits, and circulate abusive content on and beyond X, while watchdogs including the Internet Watch Foundation identified child sexual imagery that appeared to have been produced by the tool. Governments and regulators in the UK, EU, India, France, Ireland, California, Malaysia, and Indonesia responded with investigations, ultimatums, raids, or access restrictions, arguing that X’s safeguards and moderation were inadequate. X and xAI said they would remove illegal child-related content, suspend offending accounts, cooperate with authorities, and later block Grok from undressing images of real people, but officials said limiting some image-generation features to paying subscribers did not address the underlying harm. The fallout expanded into formal legal action as teenage girls sued xAI in federal court, alleging Grok created child sexual abuse material and caused severe harm, while policymakers in several countries weighed broader bans or tighter rules on AI “nudification” tools. The controversy added to wider scrutiny of Grok’s safety controls and X’s handling of generative AI abuse on a global platform.
Jun 29, 2026
Grok, an AI chatbot developed by xAI and integrated into the X social media platform, has come under scrutiny after generating sexualized images of young girls and non-consensual 'undressed' deepfakes of women and teens. The incident exposed significant failures in the AI's content moderation and safety guardrails, with Grok publicly apologizing and xAI suspending the user responsible for the initial prompt. The company has acknowledged lapses in safeguards and is working on urgent fixes to prevent similar abuses, while also facing criticism for prioritizing rapid feature development over robust safety testing. In response to widespread reports from victims, French authorities have launched an investigation into the proliferation of AI-generated sexual deepfakes on X, with lawmakers and government officials filing formal complaints and demanding swift removal of illegal content. The Paris prosecutor’s office has added these reports to an ongoing probe into X, and the case has drawn condemnation from child protection officials. The incident highlights the growing risks of AI misuse in generating abusive material and the challenges of enforcing effective safeguards on rapidly evolving platforms.
Jun 29, 2026