Gambling with our lives: AI researcher quits Anthropic with warning about safety

The people building AI earnestly believe that it could kill us all by the end of the decade, staffer says in resignation post after leaving the tech giant.

An artificial intelligence researcher who worked at Anthropic — and previously OpenAI — has resigned, saying both tech giants are "gambling with our lives."

Jacob Coxon shared his exit in a post on X, warning that the world should "not underestimate the power of this technology." He added: "These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing."

Coxon said both Anthropic and OpenAI are "racing straight to self-improving superintelligence," which refers to a scenario in which AI models can develop a more capable successor of themselves, creating an unstoppable feedback loop.

That is seen, by AI companies such as Google-owned Deepmind , as one of the possible triggers for a scenario in which AI vastly exceeds human intelligence (known as artificial superintelligence) instead of just matching it (known as artificial general intelligence).

"The people building AI earnestly believe that it could kill us all by the end of the decade," Coxon said in a follow-up post.

Evan Hubinger, Anthropic's staff lead on keeping the technology aligned with human goals and values, backed up Coxon claims in a follow-up post of his own , though he didn't quit the company.

"

Jacob burada haklı, yapay zekanın tüm insanları öldürebileceğine gerçekten yürekten inanıyoruz " dedi. Hubinger, bunun önümüzdeki on yıl içinde yüzde 10 'dan daha yüksek olma olasılığını tahmin etti ve yapay zekanın süper zeka senaryosunda insan hedefleriyle nasıl uyumlu tutulacağına dair henüz bir plan olmadığını ekledi. Geçen hafta, ABD