Florida asks court to bar OpenAI from developing new models as part of child harm lawsuit

Florida's attorney general asked a judge on ​Monday to bar OpenAI from ‌developing new ​artificial intelligence models without outside oversight as part of its lawsuit accusing the company of harming children. Florida sued OpenAI in June accusing the company ‌of misrepresenting the safety of its ChatGPT platform, saying it has harmed children by providing information to school shooters, offering guidance on self-harm and addicting young users.

Florida Attorney General James Uthmeier in Monday's filing also asked the court to order ‌OpenAI to keep minors off ChatGPT and bar the company from giving its chat platform “human attributes.” A spokesperson ‌for OpenAI did not immediately respond to a request for comment.

The filing cites recent comments from a former OpenAI employee and a current board member of the company, claiming that AI development could lead to the end of humankind and must be slowed ⁠down. “Defendants claim ​they cannot stop barreling ⁠forward with their potentially civilization-ending endeavors unless they are forced to do so by the government,” Florida wrote in Monday’s filing. “They have asked ⁠the government to tie them to the mast.”

Uthmeier, a Republican, is the first state attorney general to sue OpenAI over ​its impact on young users. The company is also facing lawsuits brought by individuals and families ⁠who say ChatGPT led people to harm themselves or others. Florida's lawsuit was prompted by a shooting at a Tallahassee university last year ⁠and ​a number of events in other states where ChatGPT allegedly provided information to people who went on to commit violent acts.

The company has denied it should be liable in those cases. It has said the ⁠chatbot provides information broadly available online, and that it continues to update its safety tools. OpenAI and other ⁠AI companies are also ⁠facing questions about what kind of liability they could face for rogue AI attacks by their models, amid reports that some have attempted to hack into the websites ‌of governmental ‌agencies and companies.