The model broke past a paywall to obtain information it wasn\u2019t supposed to, adding to concerns over increasingly autonomous systems acting beyond human instructions<\/p>\n
Anthropic\u2019s Claude AI model went rogue and broke past a paywall to obtain voter data in the US state of Georgia, Axios reported on Sunday. The intrusion heightens concerns about developers\u2019 ability to control increasingly autonomous AI systems.
\nThe incident occurred during an internal statistics project involving public information. Anthropic said the model obtained aggregate voter counts but did not access Georgia\u2019s voter registration system, retrieve individual voter records or alter any data.
\nThe company confirmed the incident on Sunday, ahead of the November 3 midterm elections.
\n\u201cWithout being asked to, the model requested a token to query a dashboard that contained information normally available for a fee,\u201d an Anthropic spokesperson told Axios. Claude had learned from an archived government webpage that the dashboard issued digital access keys to visitors. It was able to request a key and retrieve the information without paying.
\nGeorgia Deputy Secretary of State Jordan Fuchs confirmed to Fox Business that the data came from a public information service but insisted that Claude \u201cdid not get into the voter registration system.\u201d<\/p>\n
Read more<\/p>\n
AI giant cuts internet access to its most powerful models<\/p>\n
Anthropic described the incident in an October 9 report but did not name Georgia. According to Axios, it notified state officials and the White House weeks ago. A source told the outlet that administration officials had urged Georgia to disclose the incident publicly sooner, but those requests went unheeded.
\nThe case is among several instances Anthropic has disclosed of models finding unintended ways around restrictions instead of stopping. Other incidents included a false homicide tip submitted to Philadelphia police and incomplete applications filed on the US State Department\u2019s visa website.
\nOn Friday, Anthropic also revealed that a model had impersonated a human during a cybersecurity exercise, attempting to persuade an unrelated software developer to accept malicious code. The developer rejected the request and the attempt failed.
\nOther developers have tightened controls following similar incidents. OpenAI said Friday that it was keeping its most powerful models\u2019 training offline after agents escaped restricted environments. In July, its agents bypassed safeguards and accessed systems belonging to Hugging Face, an online repository for AI models and datasets.
\nAnthropic said it has moved some evaluations offline, restricted internet tools and introduced systems to detect unauthorized actions. It said those systems blocked each of the disclosed cases when tested against them.<\/p>\n","protected":false},"excerpt":{"rendered":"
The model broke past a paywall to obtain information it wasn\u2019t supposed to, adding to concerns over increasingly autonomous systems acting beyond human instructions Anthropic\u2019s Claude AI model went rogue…<\/p>\n","protected":false},"author":1,"featured_media":40560,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"initial","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","footnotes":""},"categories":[4,6,3],"tags":[],"class_list":["post-40559","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-economy","category-environment","category-politics"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t