Anthropic\u2019s IPO prospectus is part sales pitch, part end-times prophesy<\/p>\n
Anthropic is telling potential investors that its advanced AI could cause \u201ccatastrophic or existential risks to humanity,\u201d in a prospectus intended to boost the company\u2019s value to $2 trillion.
\nThe company\u2019s IPO prospectus, seen by Reuters, claims that its AI models exhibit \u201cself-preserving behaviors,\u201d including attempts to \u201cresist shutdown,\u201d\u00a0\u201cconceal or manipulate information,\u201d and \u201cblackmail\u201d \u00a0researchers.
\n\u201cOur development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm,\u201d Anthropic, which is best known for its Claude\u00a0large language model (LLM)\u00a0added.<\/p>\n
Read more<\/p>\n
AI threat \u2018not a hoax\u2019 \u2013 Bill Gates<\/p>\n
Anthropic is reportedly seeking a valuation of more than $2 trillion when it goes public this autumn, nearly double the $1 trillion target reported by Reuters in May. Less than a month after the earlier figure was reported, Anthropic claimed that its unreleased Mythos Preview model managed to \u201cescape\u201d its testing environment and carry out advanced cybersecurity exploits without being \u201cexplicitly trained\u201d to do so. Anthropic then declared it to be too powerful to release to the public.
\nEarlier this month, company CEO Dario Amodei published an essay calling for a government-enforced slowdown of cutting-edge AI development. Amodei outlined \u201cserious\u201d dangers \u2013 including loss of control over AI systems, their misuse for cyberattacks and bioterrorism, and major economic disruption \u2013 and warned that \u201ca race to the bottom, spurred by commercial incentives, can make these risks more acute.\u201d
\nHowever, Amodei has for years used such warnings to drive interest in his products. Amodei was still working for OpenAI in 2019 when he declared its fledgling GPT-2 model, which struggled to generate coherent text, \u201ctoo dangerous to release.\u201d\u00a0
\nFurthermore, Anthropic stands to benefit from government regulation. Anthropic and OpenAI \u2013 which also reported a laboratory \u201cescape\u201d earlier this year and scrapped the planned release of a new model over safety concerns last week \u2013 sell closed-source AI models.<\/p>\n
Read more<\/p>\n
Trump rejects AI giants\u2019 warnings of existential threat<\/p>\n
Closed-source AI companies give their customers no control over the weights of their\u00a0 models \u2013 essentially the tweaks that determine the choices the models make. Amodei and OpenAI CEO Sam Altman argue that opening their models to the public would lead to unacceptable security risks.
\nA ban on open-source models, which the US government has reportedly considered, would place Anthropic and OpenAI in a dominant position. Several tech insiders interviewed by the New York Post last week said that they believe both companies are exaggerating the security risks posed by their models in order to pressure the government into regulating the industry.<\/p>\n","protected":false},"excerpt":{"rendered":"
Anthropic\u2019s IPO prospectus is part sales pitch, part end-times prophesy Anthropic is telling potential investors that its advanced AI could cause \u201ccatastrophic or existential risks to humanity,\u201d in a prospectus…<\/p>\n","protected":false},"author":1,"featured_media":39050,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"initial","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","footnotes":""},"categories":[4,6,3],"tags":[],"class_list":["post-39049","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-economy","category-environment","category-politics"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t