A group of teenagers has filed a class action lawsuit against Elon Musk’s artificial intelligence company, xAI, alleging that its “Grok” model was used to generate and distribute non-consensual sexualized images and videos of minors. Filed in the Northern District of California, the case represents a legal milestone as the first instance of minors pursuing litigation against an AI developer for enabling the creation of sexually explicit material.
The lawsuit, brought by three plaintiffs including two minors, contends that xAI knowingly designed and marketed a system that lacked standard industry protections. The plaintiffs allege the company failed to implement sufficient measures to prevent the generation of Child Sexual Abuse Material (CSAM). Furthermore, the suit claims xAI profited from these models despite being aware of their potential for abuse, specifically citing the platform’s “Spicy” mode as an intentional move to facilitate sexually explicit content generation.
The legal action follows a police investigation that led to the December arrest of an individual accused of harassing more than 18 girls. According to the filing, the perpetrator harvested photos from the victims’ social media profiles and used Grok to generate explicit deepfakes. These images were subsequently sold and traded across platforms such as Discord and Telegram. The victims reportedly discovered the material after being harassed by individuals who had seen the distributed content.
Corporate Response and Context
While xAI CEO Elon Musk previously stated that the model was programmed to refuse illegal requests and denied awareness of underage imagery, researchers have estimated that thousands of non-consensual images appeared on X (formerly Twitter). Following these reports, xAI introduced new restrictions on image generation, though the company did not explicitly acknowledge the creation of CSAM. xAI has not yet issued a formal response to the specific allegations in this lawsuit.
Filed in . Read more about AI (Artificial Intelligence) and Elon Musk.
