AI company warns: 10% chance our product destroys humanity

📡 FT Alphaville · 1 min read ·
Anthropic, a leading artificial intelligence company, has told investors that its own technology carries a greater than 10% risk of causing human extinction. The warning appeared in the company's S-1 filing — a mandatory document companies submit before selling shares to the public. In it, Anthropic lists this risk as one of the main dangers facing its business. In simple terms, the company is telling investors: the product we sell could end human life, and the odds are higher than one in ten. The admission is unusual. Public filings typically focus on financial risks such as competition or regulation. Anthropic's warning places the survival of the human species in the same category. The company has not explained how it calculated the figure, nor did it say what steps it is taking to reduce it. Anthropic builds large language models — AI systems that generate text and perform tasks once done by humans. The company has long argued that such systems must be developed carefully. Its filing now makes clear that even the company itself sees a real chance its work ends badly.