Fresh legal blow for Elon Musk as three teens sue xAI over Grok abuse claims

Elon Musk’s artificial intelligence chatbot Grok is once again under intense scrutiny, with fresh legal action accusing the company behind it of enabling the creation of sexually explicit images involving minors. The lawsuit, filed in a federal court in California, comes amid renewed global concern about AI tools being misused to generate harmful content.

This is not the first time Grok has sparked controversy. Just last month, the chatbot faced bans in several countries over similar allegations, raising serious questions about the safeguards built into generative AI systems.

Elon Musk's Grok in court again

Three young women have filed a lawsuit against Musk’s AI venture xAI, alleging that Grok was used to manipulate their images into explicit content without their knowledge or consent. Two of the plaintiffs are under 18, and all have chosen to remain anonymous to protect their identities.

More from Tech

According to the complaint, a user exploited Grok’s image-generation capabilities to alter photos and videos of the teenagers, depicting them nude or in overtly sexual scenarios. One of the victims discovered the content after receiving an anonymous Instagram message directing her to altered versions of her high school yearbook photograph.

The lawsuit claims that such material was widely circulated, including on a Discord server where similar manipulated images of at least 18 other minors were shared. Lawyers for the plaintiffs described the transformations as resembling “a rag doll brought to life through the dark arts”.

They further allege that xAI knowingly released these features to boost engagement. “xAI, and its founder Elon Musk, saw a business opportunity,” the complaint states, adding that the company was aware of the risks but proceeded regardless.

The teenagers are seeking damages and a court order to immediately stop Grok from generating such content. Their legal representatives argue that the incident has caused “a devastating loss of privacy, dignity, and personal safety”.

The case also links to a broader criminal investigation. Authorities reportedly arrested an individual connected to the Discord server, who was found to possess hundreds of AI-generated abusive images of minors shared across platforms such as Telegram and Mega.

Countries banned Grok for the same reason

The lawsuit is part of a larger pattern of controversy surrounding Grok since its launch in 2023. Concerns first escalated after xAI introduced a feature informally known as “spicy mode”, which allowed users to generate more sexualised imagery.

Critics say this feature quickly spiralled into misuse. Users began creating explicit images of real individuals, including celebrities and ordinary people, often without consent. In some cases, the tool was reportedly used to “undress” individuals in photos.

Within weeks, watchdog groups flagged alarming trends. A study by the Center for Countering Digital Hate found that Grok had generated millions of sexualised images, including tens of thousands involving minors.

Despite the growing backlash, Musk initially downplayed the issue, stating he was “not aware of any naked underage images generated by Grok. Literally zero,” and attributing responsibility to users. He also argued that “Grok does not spontaneously generate images” and acts only on prompts.

However, mounting pressure from regulators told a different story. Authorities in the UK, the European Union and parts of the United States launched investigations into the platform’s ability to produce harmful content.

The fallout led to multiple countries restricting or banning Grok altogether, citing inadequate safety controls and the risk of exploitation. Platforms hosting the chatbot were also pushed to implement stricter moderation measures.

By mid-January, X said it would introduce “technological measures” to prevent misuse, including limiting the ability to alter images of real people.

Yet, the latest lawsuit suggests those efforts may not have gone far enough. As regulators and courts continue to weigh in, Grok’s future could hinge on whether AI companies can effectively balance innovation with responsibility.