AI corporate leaders tell UN the industry needs global regulation

The heads of several major AI firms told the United Nations Security Council (UNSC) their industry urgently needed global oversight to avoid dangers that could threaten the whole world.

“If managed poorly, I even believe AI could be a risk to humanity as a whole,” Dario Amodei, the chief executive officer of Anthropic, told members of the body on Wednesday.

Recommended Stories

list of 3 items

• list 1 of 3As AI leaders warn of catastrophe, US and China shun slowdown calls
• list 2 of 3As Xi meets Trump, who’s winning their trade war?
• list 3 of 3US lawmakers propose sweeping AI restrictions with superintelligence ban

end of list

Sam Altman, the head of rival company OpenAI, echoed his concerns, telling the 15-member council tasked with tackling major crises globally that humanity could “lose control of the future of AI”.

The meeting, which coincides with the UN General Assembly (UNGA) gathering in New York City, was convened by France and comes at a time when experts are increasingly warning that the rapid development of AI needs more human oversight to ensure it does not slip out of control and cause a global catastrophe.

Altman and Amodei called on world leaders to take action.

“If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone,” Altman told members. “They must be shaped through democratic processes and by governments accountable to the people they serve.”

Their concerns were shared by several representatives on the council, including the foreign ministers of France and the United Kingdom, who said the international community needed to step in and create common frameworks for how the technology should be controlled.

Hugging Face CEO Clement Delangue, whose company has come under attack by out-of-control AI models in recent months – incidents used by the other companies as evidence of the need for more safety measures – told the UNSC his company had relied on the technology to defend itself in those same incidents.