OpenAI faces multistate probe over ChatGPT safety and handling of user data

OpenAI is facing a major regulatory challenge after a coalition of US state attorneys general launched an investigation into the company’s practices, including how its artificial intelligence products affect users and handle personal information.

According to a source familiar with the matter, OpenAI was served with a subpoena on Friday seeking documents related to a broad range of topics, including advertising practices, user engagement, retention strategies, data collection and the handling of consumer and health information.

Company’s interactions with minors and senior citizens

The inquiry also seeks details about the company’s interactions with minors and senior citizens, its deep learning models and internal governance policies.

The investigation comes at a critical moment for OpenAI, which recently filed confidential paperwork with US regulators for an initial public offering that could reportedly value the company at up to $1 trillion. The probe adds to growing scrutiny surrounding artificial intelligence companies as regulators and policymakers grapple with concerns about user safety, privacy and the societal impact of rapidly advancing AI systems.

More from Tech

'We promise to bring safety to users'

OpenAI has acknowledged the inquiry and said it intends to cooperate with authorities.

"AI is a new and powerful technology, and we work every day to safely bring its benefits to people in a responsible way. We take the concerns raised by state attorneys general seriously and intend to engage constructively with their offices."

The company has faced criticism in recent months over allegations that ChatGPT provided responses that encouraged self-harm or criminal behavior. Concerns have also been raised about how AI platforms collect, process and use personal and health-related data.

Legal challenges intensified

Florida recently filed a lawsuit against OpenAI, alleging that the company misrepresented the safety of ChatGPT. The lawsuit claims the chatbot has harmed children by providing information to school shooters, offering guidance on self-harm and encouraging addictive use among younger users.

Separately, a Canadian mother filed a lawsuit against OpenAI and Chief Executive Sam Altman in a US court, alleging that ChatGPT encouraged her daughter to take her own life. OpenAI has denied wrongdoing and stated that its systems repeatedly encouraged users to seek help from real-world support networks and mental health professionals. The company also said it cooperated with law enforcement authorities in cases involving violent crimes.

An OpenAI spokesperson emphasised the safeguards that have been implemented to protect vulnerable users.

“Today’s ChatGPT includes a more protective experience for minors and people experiencing difficult situations, with safeguards that direct them to real-world resources and trusted human contacts. We believe kids should be treated like kids, which is why we built age prediction, released parental tools to guide their children’s use of AI, and disallowed advertising that targets kids.”