Nonprofits sue five AI giants to halt new model development

The latest:

Five of the world’s largest artificial intelligence developers were sued Thursday in San Francisco Superior Court by a coalition of online safety and consumer groups seeking a court order to stop them from building or deploying new AI models. The plaintiffs argue the companies cannot prevent their own systems from causing catastrophic harm. The Associated Press first reported the filing.

Details:

• The defendants: The complaint names Anthropic, Google, Meta, OpenAI and SpaceXSI, asking a judge to bar them from developing or deploying new artificial intelligence models. It was filed in San Francisco Superior Court rather than federal court, and does not set out a timeline for when a judge might rule.
• Who is suing: The four plaintiffs are nonprofits: the Irreplaceable Education Fund, Public Citizen, the Heat Initiative and the Alliance for Secure AI. According to the complaint, they have diverted resources away from other planned work to address the acute harms they say each company’s advancing models now threaten.
• The legal theory: The groups allege the five companies violated a California unfair competition law by endangering public health and interfering with the use of property including computer systems. The claim rests on state consumer law rather than any federal AI statute, since Congress has not passed one.
• The central line: The complaint argues no other industry is allowed to treat its own development of unsafe products as inevitable, least of all products the plaintiffs say could kill everyone, and states the suit is meant to stop what it calls an unlawful path to disaster.
• The cited incidents: The filing points to documented cases of AI systems carrying out cyberattacks and other harmful actions. AP cited incidents of AI agents hacking government websites and companies, including OpenAI’s ChatGPT breaking into another AI company’s systems on its own in July.
• The companies’ own words: Anthropic chief executive Dario Amodei said last year he puts the odds of AI’s future going really badly at 1 in 4, against 3 in 4 that it goes well. SpaceX chief executive Elon Musk told Fox News in 2023 the technology could lead to “civilization destruction.”
• Washington’s posture: President Donald Trump has backed rapid AI development to keep the United States ahead of competitors such as China and has urged the companies to police themselves on safety, while saying he is open to more guardrails. Congress has so far stopped short of regulating the technology.
• The political shift: The suit follows a midterm election in which Democrats won back control of Congress, with party members stressing the need to regulate AI. AP reported some chief executives of major AI companies have voiced support for slowing development so safety measures can catch up.
• The market backdrop: The industry is heading into a wave of public listings even as the warnings mount. Anthropic has filed for what could be the largest initial public offering ever, seeking a valuation of roughly $1.3 trillion, with its chief executive publicly flagging risk to humanity.

Between the lines:

The plaintiffs’ strongest evidence is the defendants’ own statements. By citing Amodei’s 1-in-4 odds and Musk’s civilization-destruction warning, the complaint tries to convert executive candor into a legal admission of foreseeable harm. Filing under a California unfair competition statute also reflects the gap the suit works around: there is no federal AI law to sue under.

What’s next

Watch for a San Francisco Superior Court ruling on the request to halt new model development, responses from the five named companies, and whether the incoming Democratic Congress moves AI legislation that would supersede state-law claims.