Filters
Filtered by category: AI Insider, tag: existential risk × Clear
Anthropic Researcher Resigns, Warns AI Labs Are Racing Toward Existential Risk
Matched: OpenAI
Jacob Coxon, a former OpenAI and Anthropic pretraining researcher, resigned this week warning that AI labs are recklessly racing toward recursive self-improvement despite privately fearing it could kill humanity by decade's end. He said Anthropic understands the risks but feels pressured to continue because it distrusts competitors to act responsibly. Colleague Evan Hubinger estimated over 10% odds of AI-caused extinction within a decade. Lawmakers in the U.S. and U.K. introduced legislation targeting superintelligence development.
Anthropic Faces Scrutiny Over Account Security and Internal Warnings on AI Risk
Matched: OpenAI
Anthropic faces two separate controversies: account security breaches affecting paying Claude users, and stark internal warnings about AI risk. Consultant Grant De Swardt discovered unauthorized token usage traced to a stolen session key; other users reported similar incidents involving infostealer malware. Separately, Anthropic safety researcher Evan Hubinger stated he believes AI has greater than a 10% chance of killing all humans within a decade, prompting alarm from advisers and calls from a former UK Treasury official for an international AI treaty.