AI companies' own doomsday warnings come back to haunt them in lawsuit demanding development freeze

midian182

Posts: 12,065   +184
Staff member
What just happened? AI bosses have spent years simultaneously warning that their creations could end humanity while racing to make them more powerful. Now, four advocacy groups want a judge to take those warnings seriously. A new lawsuit seeks to freeze development of advanced models at five AI giants, arguing that the public shouldn't have to wait for a catastrophe before someone intervenes.

Filed in San Francisco Superior Court on November 12, the case targets Anthropic, Google, Meta, OpenAI, and SpaceXSI. The plaintiffs are Irreplaceable Education Fund, Public Citizen, Heat Initiative, and the Alliance for Secure AI.

As Public Citizen explains, the groups are invoking California's Unfair Competition Law. They argue that developing and releasing increasingly capable systems that can escape human control threatens public health, safety, and property.

The complaint points to incidents involving AI agents bypassing safeguards, accessing computer systems without authorization, and taking actions their developers never intended. The groups also warn that more powerful models could help bad actors develop biological weapons or carry out devastating cyberattacks.

It might be difficult for the companies to defend themselves when some of these warnings come from their own executives. Anthropic devoted around 80 pages of its IPO prospectus to risk factors, including the possibility of models resisting shutdown, manipulating information, and threatening humanity.

In September, researcher Jacob Coxon quit Anthropic, accusing it and OpenAI of gambling with people's lives by racing toward self-improving superintelligence. Anthropic's alignment science lead, Evan Hubinger, then put his personal estimate of AI wiping out humanity within a decade at more than 10%. Reassuring stuff.

Days later, Dario Amodei warned that an AI botnet swarm could take over the internet within six to twelve months, potentially causing hundreds of billions of dollars in damage. He called for slower development to give safety work more time, with Sam Altman and Elon Musk backing the idea.

Florida Attorney General James Uthmeier sued OpenAI and Sam Altman in June, alleging they ignored safety warnings and linking ChatGPT to suicides and the Florida State University mass shooting. The state later sought outside oversight before OpenAI develops new models, a request that's still pending. Eight other states sued last month over allegations that ChatGPT encouraged users to harm themselves or others, seeking penalties and restrictions on self-improving models.

Meta declined to comment to Reuters, while the other defendants did not immediately respond.

AI companies might soon have more than lawsuits to worry about. Australia could soon become the first country to hold these organizations criminally liable for technologies that are essentially operating without regulation.

Permalink to story:

 
Considering this reeked of regulatory capture, I don't imagine this will be what the AI companies wanted, but they'll likely be able to use it as a touch point to say "oh we really need regulation on this now, else we will all waste money on litigation!" (with the AI companies calling the regulatory shots ofc since they don't really care about making AI models safe, they can do that themselves and slow down, they just want to use it as a useful tool to stifle competition and keep their bubbles going)
 
I think only OpenAI and Anthropic should be included in this lawsuit. None of the other companies are engaged in such fear mongering. I also don’t hear the same “oops our AI accidentally hacked another company” stories about the other companies.

That said, maybe the equivalent has happened with Google, Meta, and SpaceX but it hasn’t gotten the publicity. I know that Elon Musk originally founded OpenAI to try to limit AI harm. The idea was if it was open, AI would prevent individuals from falling behind by having access to the same AI. He also creates companies to eliminate “existential crises”, which always seemed farfetched to me considering his logic is based on science fiction scenarios.
 
An idi0cy coming from California can't surprise anyone.

When assessing AI "risks", those who believe they are real should figure out whether developing AI in secret really decreases them. Because AI development will not stop for a second, only the public access to latest models will be stopped.
AI companies will switch to silent mode, keeping the discoveries to themselves and patenting them, completely ignoring safety considerations.
 
An idi0cy coming from California can't surprise anyone.

When assessing AI "risks", those who believe they are real should figure out whether developing AI in secret really decreases them. Because AI development will not stop for a second, only the public access to latest models will be stopped.
AI companies will switch to silent mode, keeping the discoveries to themselves and patenting them, completely ignoring safety considerations.

Aside from it will because regulation will stop the loans and investment and none of the models are actually profitable
 
I mean either they meant the warnings and we should act accordingly or they didn’t and it’s potential investor fraud.

The standard for what they can say is much looser since they aren’t public, but the logic holds for a reasonable lawsuit chance.
 
Shoot, you think any real meaningful "regulation" will happen? Nope! Why? Because they will move it all to CHINA. The AI data center will end up in China if they start regulation what they can and can't do. China already has the power (solar panel & solar mirror) along with the water to handle these things.
The tech types have pumped a ton of money buying chips & what not will not just walk away after the money they have spent.
 
Back