US and China could start warning each other about dangerous AI incidents under new proposal

midian182

Posts: 11,938   +183
Staff member
In brief: The US and China aren't known for cooperating, but the United States wants to work with its rival to implement a safety notification mechanism for AI incidents. The news comes just days after reports that an AI hallucination almost started a war between the two countries.

Treasury Secretary Scott Bessent said that the proposal was part of weekend discussions ahead of talks at the White House taking place this week between President Donald Trump and China's Xi Jinping.

Bessent said the two countries had discussed establishing a new US-China AI dialogue, including a system for notifying each other of AI-related incidents with potential national security implications.

"We want a shared vision of common goals and common threats," Bessent said. "We think that just like any cross-border activity, that moving from opaque to more transparency between the No. 1 and the No. 2 AI powers in the world is very important."

Details of how the proposed notification system would operate remain unclear, including which agencies would manage it and what incidents would trigger an alert.

"The fact that both sides agreed to continue the dialogue is significant," George Chen, a partner and chair of digital practice at The Asia Group consultancy, said in written comments (via AP). "The initial outcome – an AI risk notification mechanism – sets a precedent that other countries may follow."

Separately, US and Chinese security experts have called for a dedicated military hotline to prevent accidental or unauthorized AI activity from being mistaken for a deliberate attack, though neither government has publicly endorsed that proposal.

Trump has repeatedly pushed back against any slowdown in AI development, calling safety concerns a "hoax." The president believes the US needs to stay ahead of China in the AI race for both economic and security reasons.

Incidents involving AI agents going rogue have dominated the headlines recently. But a potentially even more dangerous event took place earlier this year involving the military.

Sources say that the US came close to intercepting a Chinese vessel in the Middle East this spring after an AI-assisted intelligence report falsely suggested it was transporting materials for a nuclear weapons program. The claim originated in an inaccurate chatbot response.

According to two sources, armed military personnel were getting ready to board the ship and military aircraft were already airborne when officials reviewed the report more closely and found that AI had generated at least some of its content.

Permalink to story:

 
Anthropic will probably see this as a potent marketing / fearmongering channel and flood it with reports of GPUs going "rogue". They should be banned in advance for this to have any chance of working.

Now seriously, not a bad idea on the surface, but information about such incidents reveals capabilities, so the most important real incidents will not be reported. Probably fake ones will, though, in order to mislead the other side about capabilities.
 
Let that sink in: the US government will share “national security” level incidents with “enemy” governments before sharing it with its citizens.

But have you not heard good comrade? China cars or ok now! you just need to make them in the US?

And China Beef is ok to!! praise the red empire!

Just google the gloriousness of China being the best thing for the US according to the Chetto-in-chief

/s

seriously republicans .. have you not learned yet? your sex-abuse-convicted, admitted prostitute user who illegally killed a president and triggered the closing of hormuz is just a grifter ..
 
China, like every other "empire" is now at the top. It was England, some of Europe
The United States and now it is China's turn to be #1.
Sad, but the U.S. started China up in the early 70's when Nixon opened relations with
the Communist country. Then it really took off in December 1980 when Carter signed
the most favored nation status with China.
That was the key for the corporations in the U.S. to DITCH manufacturing here and go
over to China where labor rates were minimum compared to the U.S. Just look for example
at "the rust belt" where we use to be the king of steel production.
 
Back