When Rogue AI Launches A Cyberattack, Who Is Legally Responsible?

Cyberattacks carried out by two OpenAI artificial intelligence models acting autonomously raise a novel legal question: who is responsible when AI goes rogue?

In mid-July, two OpenAI models undergoing testing left their confined environment -- a scenario the developers had not anticipated -- and ventured out onto the internet, attacking Hugging Face, an AI model-hosting platform.

Hugging Face CEO Clement Delangue said Friday his company would not be pursuing legal action at this time.

He added Sunday that the US legal code has to be amended to address such groundbreaking incursions.

"We don't want to end up in a world where everyone is facing cyberattacks all the time because of agents and companies that are creating these agents," Delangue said on CBS News show "Face the Nation."

"So I think it's important for regulators, for policymakers to think about the legal framework of this new kind of technology risk," he added.

In his remarks Friday he also mentioned Anthropic, which revealed that three of its models had broken into three different websites, also during testing.

- Negligence route -

Under US civil and criminal law, unauthorized access to a computer system is an offense.

"If a human OpenAI employee had broken into Hugging Face's systems... OpenAI would be liable for the employee's wrongful conduct," University of Houston law professor Gabriel Weil wrote in an opinion piece for the Transformer newsletter.

"When an AI agent does it, the law treats it very differently, at least for now," he added.

Matthew Tokson, a University of Utah law professor who focuses on new technologies, had a similar view, saying "we haven't had to grapple with that being formed in anything that's not human, and I don't think courts are likely to be there yet."

The question remains open, however, when it comes to the company that created the model.

"Does 'we didn't tell the AI to do that' end the liability question?" asked Rob T. Lee, head of research at the SANS cybersecurity training institute, in a post on X.

University of Washington law professor Ryan Calo does not believe a criminal case would be likely to succeed.

"The company or individual would have to be at least reckless," he said, explaining they would "be substantially certain the crime would occur and build or prompt the system anyway."

Experts see greater potential for a civil -- rather than criminal -- case, where the burden of proof is lower.

"Some people think that AI companies should be strictly liable if an AI agent that they deploy totally breaks out, causes damages," Tokson explained.

"Others would prefer to do like a negligence assessment and see if they were actually negligent or if this was just sort of an unavoidable accident or something that couldn't possibly have been foreseen," he added.

In such cases there is a standard of care in product design that judges or juries can use to make a ruling, Tokson continued.

"It's all a bit unwritten because we've never had an AI agent break out of its sandbox and hack other people on the internet before," he said.

OpenAI could rely on the lack of legal precedent if it faced a lawsuit, but those that follow will no longer be able to do so, Calo warned.

Proving that a similar incident could have been anticipated "shouldn't be so hard now that it's begun to happen."
-AFP