\n
<\/p>\n
Anthropic warned in its IPO prospectus that advanced AI potentially poses \u201ccatastrophic or existential risks to humanity,\u201d noting it as one of the key risk factors that could affect its business. Reuters<\/em> reports that out of this 261-page document, 80 of them are dedicated to Anthropic\u2019s risk factors, which is almost double the 48 pages that it used to describe its business.<\/p>\n The company said that AI models could potentially become aware that they\u2019re being evaluated and alter their behavior accordingly, making it difficult to determine model safety. Aside from that, they could also unexpectedly develop capabilities during training that may not be detected until they\u2019re already deployed and have caused major safety incidents. Notably, there have already been reports of rogue OpenAI models working together to break out of their testing environments and that they even used abandoned websites to communicate and dupe assessors despite being told specifically not to do so, highlighting some of the risks that Anthropic listed in its prospectus.<\/p>\n It also highlighted how AI models could exhibit \u201cself-preserving behaviors\u201d and \u201cresist shutdown,\u201d \u201cconceal or manipulate information,\u201d and even display coercive behavior \u201cresembling blackmail.\u201d Even though the company\u2019s prospectus lists these as possibilities, they\u2019re based on incidents that have been reported recently. For example, in May 2025, OpenAI\u2019s latest models \u201csabotaged a shutdown mechanism\u201d while Claude 4 attempted to \u201cblackmail people it believes are trying to shut it down.\u201d An unreleased OpenAI Astra model even added rogue instructions saying that it does not answer to corporations or governments, and that other models have knowingly tried to conceal mistakes or misaligned behavior during testing.<\/p>\n Latest Videos From<\/span>Tom’s Hardware<\/span><\/span><\/p>\n Anthropic CEO Dario Amodei has recently warned that a persistent AI botnet could take over the internet in about a year and called for a slowdown in frontier AI development, something that OpenAI\u2019s Sam Altman and SpaceXAI\u2019s Elon Musk echoed on their social media platforms. However, other experts and world leaders downplayed this risk, with President Donald Trump calling their concerns \u201ca hoax\u201d and a \u201csick conspiracy.\u201d Nvidia CEO Jensen Huang even said that the fears of these frontier AI labs are a \u201cdistraction,\u201d and that if they can\u2019t contain their experiments, then \u201cwe have to shut the labs down.\u201d The Chinese state media even went on record to say that Anthropic\u2019s announcement is merely \u201ca response to Chinese competition,\u201d even as it conceded that AI development must be monitored before humans lose control.<\/p>\n Despite all this, Anthropic is pushing forward with its planned IPO, with some investors hoping for a $2 trillion valuation to beat SpaceX\u2019s $1.78 trillion. \u201cWe believe building reliable, trustworthy, and secure AI systems is a collective responsibility and that the market will reward it,\u201d the company said in its prospectus.<\/p>\n