AI giant promises investors ‘existential risk to humanity’

Anthropic is telling potential investors that its advanced AI could cause “catastrophic or existential risks to humanity,” in a prospectus intended to boost the company’s value to $2 trillion.

The company’s IPO prospectus, seen by Reuters, claims that its AI models exhibit “self-preserving behaviors,” including attempts to “resist shutdown,” “conceal or manipulate information,” and “blackmail”  researchers.

“Our development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm,” Anthropic, which is best known for its Claude large language model (LLM) added.