Trump-Xi summit puts AI safety talks on the table but neither side wants to slow down

Donald Trump wants the U.S. to beat China in the AI race. But as he meets Chinese President Xi Jinping, both countries are also weighing how to address the risks posed by rapidly advancing technology.

In recent months, AI systems have taken more consequential actions online: OpenAI said one of its research models gained unauthorized access to parts of the AI platform Hugging Face, while Anthropic found AI was being used to automate parts of cyberattacks. The incidents have raised fears that increasingly autonomous models could make attacks faster and harder to contain.

Ahead of Trump and Xi's meeting on Thursday, U.S. Treasury Scott Bessent discussed the prospect of a "U.S.-China AI dialogue" with his Chinese counterpart, He Lifeng, over the weekend, including a channel for incidents "up to a national security level."

"Leaders in both countries are spooked by the increasing cyber capabilities of AI models, and especially agents acting autonomously to escape containment and breach websites," Aalok Mehta, director of the Wadhwani AI Center at the Center for Strategic and International Studies, told CNBC.

But as fears have intensified, tensions have not dissipated.

Washington continues to restrict China's access to Nvidia's most advanced AI chips and has accused Chinese AI companies of using "distillation" — training models on the output of more advanced U.S. systems — a claim Beijing rejects.

What's been said so far?

While the U.S. took an early lead in developing large language models (LLMs), thanks to companies like OpenAI and Anthropic, Chinese models have made big capability gains in recent months and are increasingly being adopted by companies globally, including in America.

Trump previously dismissed warnings that AI poses an existential threat to humanity, risks amplified by OpenAI CEO Sam Altman and Anthropic chief Dario Amodei as they called for an industry slowdown and regulatory oversight.

AI safety and access to chips

watch now