While agents cause trouble, calls for AI regulation mount from Anthropic, lawmakers

BOSTON -- Hours before President Trump was set to meet with AI leaders at the White House, another group of tech leaders, including an Anthropic representative, spent time Tuesday morning discussing the pace of AI technology, regulation and the security of AI systems.

Anthropic CEO Dario Amodei met at a luncheon with Trump, House Speaker Mike Johnson, Nvidia CEO Jensen Huang, OpenAI president Greg Brockman, SpaceX owner Elon Musk and other top AI executives. Two days ago, Amodei had a private dinner with the president. That was two weeks after he authored a widely read blog post calling on the AI industry to slow down so safety can keep up.

It’s unclear what resulted from these talks. Trump has been mostly firm in opposing most AI regulation, particularly because he says it could cause the U.S. to lose the AI race against China. After the lunch, he said he signed a "morally binding" AI agreement and emphasized that the AI industry is "self-policing."

“When an AI company says its technology is safe, there needs to be an independent evaluator to verify that that's true, and the government needs to have the power to step in and do something about it,” Peters said. “It's really important that the industry, that the companies at the frontier, make sure that they're investing, that they're incentivized to keep safety at pace with that kind of development.”

AI vendors need to agree

He added that while Anthropic has committed to having independent evaluators voluntarily examine its work, other AI vendors also need to step in.

“They’ve said they will, but one of the challenges is how do you know?” Peters continued.

Meanwhile, among a raft of state and federal legislation Anthropic is supporting is a $561 million bond-funded Massachusetts economic development package, which includes provisions for safety guardrails for AI systems.

Not a hindrance to open source

No regulation: bad consequences

Innovation and human-in-the-loop

About the Author

News Writer, AI Business