Anthropic CEO Dario Amodei explains why we must slow the pace at which we improve the capabilities of AI models

Anthropic CEO Dario Amodei called for a slower pace of AI development, warning that rapid advances could outpace human control. He proposed stronger safety checks, coordination among AI firms and governments, and greater focus on alignment and evaluation.

Days after Anthropic researchers sounded an alarm over rapidly evolving artificial intelligence (AI) technology, claiming that it 'could kill us all by the end of the decade,' Anthropic CEO Dario Amodei publicly acknowledged that AI firms should consider slowing down the pace.

In an essay titled "We Must Pace the Frontier," published on Saturday (local time), Amodei wrote extensively about the associated risks, the reasons behind his call for caution, and the proposed safeguards for pacing the frontier.

The Anthropic CEO began his essay by stating that he has worked on AI for the last twelve years because he believed that it could "dramatically raise the quality of human life."

Here are the top highlights from Amodei's essay:

1. Embedded Evaluators: Each frontier AI company will give independent third-party evaluators ongoing access to verify its safety practices, report incidents, and assess the alignment of both AI models and their training processes.

2. Democratic Coordination: Frontier AI companies in democratic countries should work together to develop common safety standards and agree on limits to unchecked AI development.

3. Global Coordination: The US and other democratic governments should seek cooperation with authoritarian states where feasible, while recognising the difficulties involved in verifying whether they comply with agreed commitments.

• According to Amodei, a slower pace will allow companies to focus more resources on several areas, including operational excellence, alignment, interpretability, and testing and evaluation.

Anthropic CEO's call ultimately focuses on finding a balance between advancing AI’s potential and ensuring that its development remains safe, controlled, and beneficial to humanity.

Swati Gandhi