Executives at prime AI corporations like OpenAI and Anthropic are plotting potential responses if an AI disaster triggers a “public and political revolt,” according to a report.
The preparations focus on creating contingency plans in the occasion that one of their AI fashions causes main public hurt – such as a hack focusing on the energy grid, water provide or banking system, Axios reported Friday.
It’s unclear if the preparations are much totally different from the tabletop workouts that establishments ranging from banks to the Pentagon and beyond have long used to assess risk.
“The Hugging Face incident confirmed that we underestimated the real-world cyber capabilities of our AI fashions, OpenAI cofounder Greg Brockman said in an essay printed in August. NurPhoto via Getty Images
Still, the report emerged during a period of unprecedented scrutiny of AI companies as some researchers, such as ex-Anthropic worker Jacob Coxon, warn that unchecked rogue AI could wipe out humanity.
“As many companies across industries do, OpenAI conducts preparedness exercises where teams discuss and work through a range of potential scenarios,” an OpenAI spokesperson said in a assertion.
“These scenarios are not treated as inevitable, but are meant to help us prepare for a variety of circumstances,” the spokesperson added. “We have been clear that AI is changing the cyber threat landscape and are focused on getting capable tools into the hands of defenders.”
OpenAI has been going through additional scrutiny following current revelations that some of its AI agent went rogue, escaped their testing “sandbox” and hacked rival AI firm Hugging Face.
Anthropic CEO Dario Amodei seems to be on as he takes half in a session on AI during the World Economic Forum annual assembly in Davos on Jan. 23, 2025. AFP via Getty Images
Greg Brockman, co-founder of Open AI, arrives at the White House for a lunch with technology leaders and President Donald Trump in Washington on Sept. 29. Zuma / SplashNews.com
“The Hugging Face incident showed that we underestimated the real-world cyber capabilities of our AI models. We are strengthening our safety requirements accordingly, which in turn adds even more urgency to our existing safety research and internal security work,” OpenAI cofounder Greg Brockman said in an essay printed in August.
Anthropic has been equally outspoken about the potential dangers of superior AI. The company’s CEO Dario Amodei called in September for an industrywide pause in frontier AI development and endorsed the concept of embedding third-party security evaluators at prime companies.
The company also launched an alarming report last month detailing makes an attempt by unhealthy actors to use its Claude chatbot for nefarious functions – such as building guided missiles and monitoring American ship and plane actions.
Anthropic did not immediately return a request for remark.
Source hyperlink
