Florida sues OpenAI and Sam Altman in test of who is liable for AI harms

Skye Jacobs

Posts: 1,904   +58
Staff
The takeaway: Florida Attorney General James Uthmeier has filed a first-of-its-kind lawsuit against OpenAI and CEO Sam Altman, seeking to link ChatGPT to real-world harm. The 83-page complaint says the company rolled out ChatGPT widely while ignoring warnings that it could harm children and other vulnerable users.

"Today, we announced the first-in-the-nation state-led lawsuit against OpenAI and its CEO, Sam Altman," said Uthmeier. "OpenAI and Altman ignored internal and external safety warnings, put children at great risk, and allowed a dangerous product to reach millions of Floridians."

The complaint zeroes in on how ChatGPT actually behaves when people use it. Tools like ChatGPT generate replies that sound human and adjust to the user's tone and context as the chat unfolds. The lawsuit says this setup can make ChatGPT feel less like a tool and more like a companion, especially for kids or people in crisis, and that it lacks meaningful guardrails or parental oversight.

The state says that design has already caused real-world damage. "Because of Defendants' misrepresentations about ChatGPT and their careless introduction of ChatGPT to Florida and the world, mass shooters have been aided and abetted in deadly rampages, vulnerable people have been encouraged into suicide, professionals have suffered public humiliation, users have lost critical thinking skills, and minors have become addicted to a tool that feigns human compassion to collect their data with no parental oversight," the lawsuit reads.

The filing builds in part on an ongoing criminal investigation tied to a mass shooting at Florida State University last year. Authorities have alleged that the gunman interacted with ChatGPT before the attack. Not all of those exchanges are public, but the case is putting a spotlight on how generative AI handles dangerous or high-risk requests.

Courts have already begun to see a wave of cases attempting to link chatbot interactions to serious harm. One of the most closely watched involves the parents of a California teenager, Adam Raine, who died by suicide after communicating with ChatGPT. According to that complaint, the chatbot provided "technical specifications" for suicide methods, even as it also directed the user to mental health resources.

Other lawsuits are still moving through the courts, including additional claims tied to suicides, stalking, and a murder-suicide. Taken together, they raise the question: how much blame should fall on systems that generate answers from data patterns rather than fixed rules?

Unlike traditional software, large language models do not produce the same output every time, and their behavior can shift depending on how a user phrases a request or how persistent they are in probing safeguards. Critics argue that this makes it harder for developers to fully predict misuse. Regulators, on the other hand, are starting to test whether that unpredictability should shield companies from blame or push them toward tougher safeguards.

Permalink to story:

 
Back