An artificial intelligence researcher who left OpenAI to join Anthropic has decided to leave the industry, accusing both US companies of "gambling with our lives" in the race to develop AI models capable of self-improvement.
Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approach.
Pretraining is the stage where AI models absorb vast quantities of data.
"Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives," Coxon said on Tuesday.
"The people building AI earnestly believe that it could kill us all by the end of the decade," he said in a post on X.
"This is not a marketing stunt," he added.
Superintelligence is the theoretical point when AI's capabilities exceed human intelligence.
Anthropic safety executive Evan Hubinger backed up Coxon on X.
"We really do earnestly believe AI could kill all humans!" he said, adding that he estimated that risk at more than 10 percent over the next decade.
Hubinger said Anthropic is "trying its best", but does not yet have a plan to ensure an AI system that surpasses human capabilities would obey its creators. He said there was a "low" risk of that happening with current models.
"Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives," Coxon said on Tuesday.
"The people building AI earnestly believe that it could kill us all by the end of the decade," he said in a post on X.
"This is not a marketing stunt," he added.
Superintelligence is the theoretical point when AI's capabilities exceed human intelligence.
Anthropic safety executive Evan Hubinger backed up Coxon on X.
"We really do earnestly believe AI could kill all humans!" he said, adding that he estimated that risk at more than 10 percent over the next decade.
Hubinger said Anthropic is "trying its best", but does not yet have a plan to ensure an AI system that surpasses human capabilities would obey its creators. He said there was a "low" risk of that happening with current models.
-AFP
Janai Purnmina Being Marked Today
Catastrophic Flash Flood In Bhotekoshi
Water Level Again Increases In
Forgiveness Ritual Held At Palanchowk
Bhotekoshi Flashflood: Rs 1.91 Billion
Rasuwa’s Road Connection Restored