A scale balance with an open padlock on one side and a shield on the other, rendered in bright warm lighting against a clean background.
News

Anthropic Draws a Line on Open Weights — But Not the One Critics Expected

Anthropic's CEO clarifies the company's stance on open-weight AI models, backing chip export controls and safety testing over protectionist bans.

AnthropicOpen WeightsAI PolicyDario AmodeiExport Controls

Anthropic CEO Dario Amodei has issued a clear position on open-weight AI models, and the headline is not what critics assumed. In a blog post published July 27, Amodei stated bluntly: “Anthropic has never advocated for a ban on open-weights models.” The post comes amid reports that US officials are considering restricting Chinese open-weight models and after a coalition of tech companies signed a letter defending open access.

🔍 THE BOTTOM LINE

Amodei’s position is more nuanced than either side of the open-weights debate wants. He rejects protectionist bans as useless, but he also rejects the argument that open access makes everyone safer. His three prescriptions — chip export controls, targeting distillation, and mandatory pre-release safety testing — would not ban open models, but they would make building the most powerful ones far harder for anyone the US government considers a threat.

What the Post Actually Says

Amodei frames his argument around two “nightmare scenarios.” The first is authoritarian governments — he names the Chinese Communist Party explicitly but says it is not the only concern — building AI models more powerful than those built by the US and using them for military superiority or domestic repression. He notes this concern is shared within the US government, citing Vice President Vance’s warning in Paris last year and the Intelligence Community’s 2026 Annual Threat Assessment.

The second is the misuse of powerful AI models for cyberattacks or biological attacks. On this point, Amodei concedes that open-weight models present a “higher risk” than closed models because guardrails cannot be applied or monitored once weights are released. But he argues that banning US businesses from using these models does nothing to address the risk, because “bad actors are unlikely to be legitimate US businesses.”

Three Measures Anthropic Supports

Instead of bans, Amodei backs three specific policies:

  1. Chip export controls. China has limited domestic chip production capacity, Amodei argues, and cannot build more powerful models than the US without access to American chips. Maintaining and enforcing export controls is, in his words, “the most efficient and direct way” to block the authoritarian-government threat.

  2. Targeting distillation operations. Amodei references distillation — the practice of using a powerful model to train a smaller one — as a loophole that needs closing. This is a pointed reference to Chinese companies reportedly using US frontier models to train their own.

  3. Pre-release safety testing. The most consensus-friendly proposal: test models for cyber, biological, and alignment risks before release. Amodei notes the Trump administration has moved in this direction and that the framework would need to be global to be effective — “even the CCP would need to be on board.”

The Open Letter and Where Anthropic Disagrees

Amodei acknowledges the open letter signed by many tech companies defending open-weight models. He agrees with much of it: open weights expand access, strengthen competition, and give customers control. But he pushes back on two claims — that open models necessarily make it easier to develop safeguards, and that broad access helps defenders more than attackers.

“It seems at least as likely to me that the opposite will be true,” he writes, citing biological threats as a domain where attackers have a structural advantage. He references a UK AI Security Institute report that found open-weight release creates “a persistent and irreversible risk of misuse” because safeguards can be removed and copies redistributed beyond monitoring.

The Geopolitical Context

This post lands at a moment of intensifying debate. The Trump administration is nearing a voluntary framework that would require major AI companies to submit advanced models to the government before public release. Nvidia has separately formed an alliance to back open-source AI amid debate over Chinese-made technology. And the open-weights landscape has been shifting for months — as we reported in our coverage of China’s open-weights strategy and the Nvidia-Microsoft open-weights coalition.

Amodei’s post reads as an attempt to occupy the middle ground: not anti-open, not pro-open, but pro-safety-testing and pro-chip-controls. Whether that position survives contact with the political process — where protectionist bans are easier to sell than nuanced testing frameworks — is a separate question.

NZ Angle

New Zealand sits at the edge of these debates rather than the centre. If the US adopts mandatory pre-release safety testing for frontier models, it could set a de facto global standard that NZ-based companies using US AI services would encounter through compliance requirements. And if chip export controls tighten further, the cost of compute — already a barrier for NZ AI startups — could rise. The open-weights question matters here precisely because NZ lacks the domestic compute to train frontier models, making access to open-weight alternatives more consequential.

❓ FAQ

Does Anthropic want to ban open-weight models? No. Amodei explicitly states Anthropic has never advocated for such a ban and calls protectionist bans “not a useful measure.”

What does Anthropic want instead? Three things: maintaining chip export controls, targeting distillation operations that let companies copy frontier model capabilities, and mandatory pre-release safety testing for dangerous capabilities.

Why does Amodei think open weights are riskier than closed models? Because once weights are released, safeguards can be removed and copies redistributed without oversight. He cites the UK AI Security Institute’s finding that this creates “persistent and irreversible risk.”

Would these measures affect NZ? Indirectly. NZ companies using US AI services could face compliance requirements if testing frameworks become standard. Tighter chip controls could raise compute costs for local startups.

🔍 THE BOTTOM LINE

Amodei’s post is a careful attempt to separate Anthropic from the protectionist camp without joining the open-everything camp. The three measures he supports are designed to sound reasonable to both sides while quietly maintaining the chip-control architecture that keeps US frontier models ahead. The real test is whether “global pre-release safety testing” is achievable when the countries building the most capable models have no incentive to participate.

📰 Sources

Sources: Anthropic, BBC News, Hacker News