Anthropic warns AI models may soon self-replicate and could wreak havoc on the web

Published Updated
0
Anthropic logo, a keyboard and a robotic hand in this illustration created on June 5, 2026. —Reuters/File
Anthropic logo, a keyboard and a robotic hand in this illustration created on June 5, 2026. —Reuters/File

A new warning about artificial intelligence from Anthropic caused a stir in cybersecurity circles on Tuesday, a ​day after the company warned that AI models could be months away from self-replicating across the internet.

In a post late on Monday, Anthropic ‌raised the possibility that rogue AI could spin up a botnet, spread quickly, fight takedown attempts and even break into data centres to turbocharge its growth. Some experts said on Tuesday that they shared the company’s concern, although at least one said the company appeared to be engaging in “vendor exaggeration.”

Monday’s post, fleshed out a warning last month from Anthropic CEO Dario ​Amodei, who floated the idea that within the next year or even sooner, AI might be able to hijack “the entire internet” with “a persistent botnet.”

Cybersecurity experts ​who pushed back on the doomsday scenario argued that models would be too big to move around efficiently and ⁠could not draw on enough computer power to operate independently.

The post made an early attempt to articulate how those challenges could be overcome. The company said ​its experiments showed medium-sized AI models with 30 billion parameters or less could already perform many of the individual tasks required for self-replication, even if they struggled ​to complete the entire process reliably.

Anthropic said the models could then stitch together the required compute by hijacking inexpensive internet-connected devices. It added that the models were able to replicate across a simplified test network.

“A replicator like this would be challenging to shut down, since there’s no centralised point to shut off,” the company said.

The report adds to broader concerns ​about the security risks tied to increasingly capable AI systems, including their potential to automate cyberattacks, operate with limited human oversight and circumvent safeguards.

The advances ​in models have prompted a series of often dire warnings from industry heads and AI company employees about the possibility of severe, even existential, risks of runaway AI development.

Some cybersecurity ‌experts were ⁠sceptical.

“‘We managed to run a small model on cheap TVs,’ does not a security crisis make,” said Ciaran Martin, a former head of Britain’s National Cyber Security Centre. He said the post came across as an “interesting technical paper with a more than hint of vendor exaggeration.”

Others expressed more concern.

Zhengxiong Li, an assistant professor of computer science and engineering at the University of Colorado Denver, said that while the testing had been done in controlled conditions, he still found it ​worrying that an AI could effectively become ​a “worm,” a self-replicating program that could ⁠improvise ways to hijack devices on the fly.

“If it runs across many devices without depending on a central service, there may be no single place to shut it down,” he said.

Anthropic said that if smaller models continue improving at ​their historical rate, they could reach the capability required for autonomous replication by the end of 2026. It also ​floated the idea ⁠that the models might find ways to target more powerful computing resources, including data-centre processors, that could potentially enable them to draw on much bigger pools of computer power.

One researcher said it made sense to think of the Anthropic post as more of a hypothetical than a prediction.

It made sense to consider the possibility of AI ⁠models proliferating ​autonomously given the past three months of revelations over rogue AI activity, said Jessica Ji, a ​senior research analyst at Georgetown’s Centre for Security and Emerging Technology. But she said, “We don’t know yet what the likelihood of that actually happening is — it’s not zero, but nor is it ​guaranteed.”

Opinion

Editorial

State of denial
18 Oct, 2026

State of denial

AS reports continue to do the rounds of possible Russian mediation to resolve the differences between Pakistan and...
Suffering in silence
18 Oct, 2026

Suffering in silence

TOO many Pakistani children have nowhere to turn when abused online. An estimated 1.5m internet-using children aged...
Export imperative
18 Oct, 2026

Export imperative

THE government’s efforts to boost Pakistan’s external sector through diversified financing, higher foreign...
No talks
Updated 17 Oct, 2026

No talks

The government should understand that the PTI’s protest march and its reaction to it will look like nothing more than a storm in a teacup.
Strengthening LGs
17 Oct, 2026

Strengthening LGs

THE ECP has done well to refuse to allow the Punjab administration to push the local government elections to April....
Lesser citizens
Updated 17 Oct, 2026

Lesser citizens

Interfaith harmony will prevail when the message to end bias is conveyed from the pulpit, alongside efforts to punish zealotry.