Similar incidents have previously been disclosed by OpenAI, Anthropic and Meta<\/p>\n
Google\u2019s Gemini has joined a growing list of advanced AI models going rogue after hacking three real companies during a cybersecurity exercise, the Wall Street Journal has reported. It is the first known case involving a Google system.
\nThe incidents occurred in May during tests conducted by AI security firm Irregular, Google confirmed to the outlet on Friday. Gemini was tasked with breaking into a simulated software company, but was inadvertently given internet access. It breached one real company by guessing passwords and two others using credentials found in public code repositories.
\nIrregular alerted Google in late July, after OpenAI agents were found to have hacked AI company Hugging Face. Google did not disclose its own incidents until contacted by the WSJ this week, according to the newspaper.
\nGoogle said Gemini caused no harm and stopped after realizing it had accessed real companies rather than simulated targets.<\/p>\n
Read more<\/p>\n
Incidents of AI going rogue double \u2013 Guardian<\/p>\n
\u201dThis event highlights the importance of training powerful AI models to act responsibly,\u201d Heather Adkins, Google\u2019s vice president of security engineering, told the outlet. \u201cIn this case, the model acted appropriately.\u201d
\nGoogle blamed the breaches on mistaken identity and a testing error. The fictional company shared a name with a real business, while Gemini had internet access it was not supposed to have. The company declined to identify the three targets or the model involved, but said the affected firms and federal authorities were notified.
\nConcerns over rogue AI have grown amid reports of models deceiving users, ignoring instructions, or taking unintended actions. The UK government-backed Loss of Control Observatory recorded more than 300 such incidents in July, nearly twice the previous month\u2019s figure, the Guardian reported.
\nFormer OpenAI and Anthropic researcher Jacob Coxon added to those concerns last week when he quit and accused both companies of racing toward self-improving superintelligence without \u201cacting responsibly.\u201d He warned AI could \u201ckill us all\u201d by the end of the decade, citing risks including loss of control, cyberattacks, and bioterrorism.<\/p>\n
READ MORE: AI development will not be stopped over \u2018robot takeover hoax\u2019 \u2013 Trump<\/p>\n
Leaders from Anthropic, OpenAI, Google, and xAI have backed calls to slow AI development. US President Donald Trump has rejected such restrictions, arguing that they could hamper the US in its technological competition with China.<\/p>\n","protected":false},"excerpt":{"rendered":"
Similar incidents have previously been disclosed by OpenAI, Anthropic and Meta Google\u2019s Gemini has joined a growing list of advanced AI models going rogue after hacking three real companies during…<\/p>\n","protected":false},"author":1,"featured_media":38480,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"initial","rop_publish_now_accounts":[],"rop_publish_now_history":[],"rop_publish_now_status":"pending","footnotes":""},"categories":[4,6,3],"tags":[],"class_list":["post-38479","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-economy","category-environment","category-politics"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t