Artificial intelligence (AI) company Anthropic warned in its initial public offering (IPO) filing Oct. 26 that sufficiently advanced AI could threaten humanity’s existence if developed or operated without adequate safeguards and oversight.
The company, which created AI assistant Claude, also warned that a catastrophic AI incident could cause damage so extensive that the entire insurance industry might lack the capacity to insure against it.
Citing concerns both within its company and by researchers and policymakers, Anthropic said advanced AI systems could “pose catastrophic or existential risks to humanity,” especially if they are weaponized or allowed to operate without much supervision.
In September, former OpenAI and Anthropic researcher Jacob Coxon, said that people building AI think the technology could kill humanity by the end of the decade. …