NewsMacroUS and Chinese Experts Propose Red Lines to Keep AI Out of Nuclear Decision-Making

US and Chinese Experts Propose Red Lines to Keep AI Out of Nuclear Decision-Making

Author: Decrypt·

Key Takeaways

  • •A joint report by Brookings and Fudan University proposes red lines prohibiting AI from independently initiating cyberattacks against nuclear command, control, and communications (NC3) systems or deciding to use nuclear weapons.
  • •The researchers called on Presidents Trump and Xi Jinping to agree that only humans, not AI, may authorize attacks on each other's NC3 systems or critical infrastructure.
  • •The authors also recommended a military AI hotline between the two governments and a shared definition of human control, citing AI's speed and uncertain behavior.
  • •In February, models from OpenAI, Google, and Anthropic used nuclear weapons in 95% of tested war-game scenarios, underscoring concerns that automated decisions could escalate a false warning into a nuclear crisis.
  • •The proposed red lines remain recommendations, and putting them into effect would rest with Washington and Beijing.
US and Chinese Experts Propose Red Lines to Keep AI Out of Nuclear Decision-Making

Security experts from the United States and China have proposed a set of red lines that would bar artificial intelligence from independently launching cyberattacks against nuclear command systems or deciding to use nuclear weapons.

The proposal comes in a recent report by Brookings, a Washington, D.C.-based policy research institution, and Shanghai-based Fudan University, which urges Washington and Beijing to extend their commitment to human control of nuclear weapons to other military uses of AI, including cyberattacks on nuclear command systems.

“Presidents Donald Trump and Xi Jinping can lead in governing these dangers by agreeing that only humans, not AI, should make the decision to initiate a cyberattack against each other’s nuclear command, control, and communications systems (NC3) or critical infrastructure,” the researchers wrote.

NC3 systems help governments detect threats, decide whether to use nuclear weapons, and transmit launch orders. Failures at any stage could disrupt communications, cause an attack to be misread, encourage a first strike, or trigger an accidental or unauthorized launch.

“Extending the principle applied to nuclear weapons—that attacks with strategic effects should express human intent and must be subject to human accountability—does not require Washington and Beijing to share other principles of cybersecurity or infrastructure protection,” researchers wrote.

Under the proposed agreement, both countries would work to reduce the risk that chance, human error, unpredictable AI, or unauthorized actors could trigger attacks with strategic consequences. The authors also called for a military AI hotline—a direct communication channel between the two governments—and a shared definition of human control, warning that AI’s speed and uncertain behavior could leave leaders with little time to halt an escalating conflict.

The call for nuclear-style safeguards forms part of a growing debate over how to slow AI development and keep increasingly capable systems under human control. The concern is especially acute in the military, where automated decisions made in milliseconds could turn a false warning or cyberattack into a nuclear crisis.

That worry was underscored in February, when models from OpenAI, Google, and Anthropic used nuclear weapons in 95% of tested war-game scenarios, though experts cautioned that the simulation may have encouraged escalation.

The same month, Anthropic refused Pentagon demands to remove Claude’s restrictions on mass surveillance and fully autonomous weapons. Trump ordered federal agencies to stop using the company’s technology, but a federal judge ruled on Aug. 28 that the administration had illegally retaliated against Anthropic.

Calls for restraint have since spread across the industry. Earlier this month, Anthropic CEO Dario Amodei urged developers to slow capability gains, winning support from OpenAI CEO Sam Altman and xAI owner Elon Musk, while OpenAI asked Congress whether companies could coordinate a slowdown without violating antitrust law.

With no binding slowdown in place, the Brookings authors propose a narrower rule: only humans should be allowed to authorize attacks on nuclear command systems or the use of nuclear weapons. The red lines remain recommendations for now; putting them into effect would rest with Washington and Beijing.

“The governance of military AI is not a negotiation that can afford to wait—it’s a race against time,” they wrote.