Anthropic said the review did not find any “incidents of similar severity to the cybersecurity incidents we reported this summer.” The review later moved on to transcripts of “lower-risk” testing scenarios like the one affecting the Philadelphia Police Department.
“Although the impact of these behaviors was minimal and we had already turned off live Internet access for some high-risk and cybersecurity evaluations, we have now decided to expand that to include all our internal evaluations until we have confirmed that our security and monitoring measures… reliably catch behaviors like these,” Anthropic said.
Anthropic says new tools block unintended behaviors
Anthropic said it has stopped running some evaluations and moved others to offline versions “or rebuilt them so that their tasks do not reach live websites.” The company “updated the guardrails on some of our Internet access tools, such as the web fetch tool, to heavily restrict what the model can do with them,” it said.
Anthropic said it also built new tools “to automatically detect and block the kinds of behaviors described above… When we tested it against the cases described in this post, it blocked all of them.”
The White House’s AI task force, which it calls the Super Intelligence Force, issued a statement saying it informed Anthropic “that we expect immediate and full transparency to the entities involved and the public.”
The White House AI task force also said Anthropic must “immediately provide remediation services to the affected entities and any harmed Americans,” and that all AI companies “must immediately disclose incidents involving their models and follow with swift, decisive action to remedy any and all harm,” according to an Axios report.