Anthropic’s AI Slowdown Call Wins Allies but Runs Into a China Problem

Dario Amodei wants frontier AI labs to slow capability gains while outside safety checks catch up. The proposal has drawn unusual support from rivals, but critics question whether it can escape profit incentives, regulatory capture and the U.S.-China race.
Anthropic’s AI Slowdown Call Wins Allies but Runs Into a China Problem

Anthropic’s AI Slowdown Call Wins Allies but Runs Into a China Problem
Anthropic CEO Dario Amodei has turned an already heated safety debate into a concrete demand: frontier AI companies should deliberately slow the pace at which they make their models more capable.

In an essay published Saturday, Amodei argued that spending more on safeguards is no longer sufficient because AI is becoming better at helping build its own successors. “We must slow the pace at which we improve the capabilities of A.I. models,” he wrote, arguing that extra time could allow alignment and safety work to catch up. He warned that unchecked progress could outstrip humanity’s ability to understand and control the systems.

Anthropic’s immediate commitment is to give independent evaluators permanent, employee-level access to its systems, including the ability to assess safety practices and report incidents. Amodei presented that as the first part of a three-step plan: outside oversight, shared standards among companies in democratic countries, and eventual coordination with authoritarian governments on narrowly defined dangers. He announced the move himself on X.

The urgency follows mounting concern over AI-agent security incidents and a public resignation by Anthropic researcher Jacob Coxon, who said leading labs were “gambling with our lives” in a race toward self-improving superintelligence. Amodei has suggested that a slowdown of even one or two years could materially reduce the odds of catastrophe.

The response from rivals was strikingly sympathetic. OpenAI chief Sam Altman said he agreed on pacing the frontier, while Elon Musk offered a blunt endorsement: “Dario is right.” David Sacks, meanwhile, said Anthropic and OpenAI should proceed precisely because they constitute a frontier-AI “duopoly.”

But the apparent consensus conceals a sharp dispute. Critics of existential-risk messaging argue that a safety compact led by the two biggest labs could become regulatory capture, rather than meaningful public protection. And Amodei’s plan faces its toughest test abroad: he acknowledges U.S. companies cannot indefinitely restrain themselves if Chinese developers continue advancing, making chip controls and limited U.S.-China agreements central to any workable slowdown.

Continue reading https://foxvector.com/stories/01a09a94-cf6e-11ed-70ec-28c9f70519da

Write a comment